Timezone: »

 
Attentive Grouping and Graph Neural Networks for Object-Centric Learning
Thomas Kipf
Event URL: https://slideslive.com/38930703/attentive-grouping-and-gnns-for-objectcentric-learning »

To enable explicit representation of objects in neural architectures, a core challenge lies in defining a mapping from input features (e.g., an image encoded by a CNN) to a set of abstract object representations. In this talk, I will discuss how attention mechanisms can be used in an iterative, competitive fashion to (a) efficiently group visual features into object slots and (b) segment temporal representations. I will further highlight how graph neural networks can be utilized to learn about interactions between objects and how object-centric models can be trained in a self-supervised fashion using contrastive losses.

Author Information

Thomas Kipf (Google Research)

More from the Same Authors

  • 2023 Poster: Invariant Slot Attention: Object Discovery with Slot-Centric Reference Frames »
    Ondrej Biza · Sjoerd van Steenkiste · Mehdi S. M. Sajjadi · Gamaleldin Elsayed · Aravindh Mahendran · Thomas Kipf
  • 2023 Poster: Scaling Vision Transformers to 22 Billion Parameters »
    Mostafa Dehghani · Josip Djolonga · Basil Mustafa · Piotr Padlewski · Jonathan Heek · Justin Gilmer · Andreas Steiner · Mathilde Caron · Robert Geirhos · Ibrahim Alabdulmohsin · Rodolphe Jenatton · Lucas Beyer · Michael Tschannen · Anurag Arnab · Xiao Wang · Carlos Riquelme · Matthias Minderer · Joan Puigcerver · Utku Evci · Manoj Kumar · Sjoerd van Steenkiste · Gamaleldin Elsayed · Aravindh Mahendran · Fisher Yu · Avital Oliver · Fantine Huot · Jasmijn Bastings · Mark Collier · Alexey Gritsenko · Vighnesh N Birodkar · Cristina Vasconcelos · Yi Tay · Thomas Mensink · Alexander Kolesnikov · Filip Pavetic · Dustin Tran · Thomas Kipf · Mario Lucic · Xiaohua Zhai · Daniel Keysers · Jeremiah Harmsen · Neil Houlsby
  • 2023 Oral: Scaling Vision Transformers to 22 Billion Parameters »
    Mostafa Dehghani · Josip Djolonga · Basil Mustafa · Piotr Padlewski · Jonathan Heek · Justin Gilmer · Andreas Steiner · Mathilde Caron · Robert Geirhos · Ibrahim Alabdulmohsin · Rodolphe Jenatton · Lucas Beyer · Michael Tschannen · Anurag Arnab · Xiao Wang · Carlos Riquelme · Matthias Minderer · Joan Puigcerver · Utku Evci · Manoj Kumar · Sjoerd van Steenkiste · Gamaleldin Elsayed · Aravindh Mahendran · Fisher Yu · Avital Oliver · Fantine Huot · Jasmijn Bastings · Mark Collier · Alexey Gritsenko · Vighnesh N Birodkar · Cristina Vasconcelos · Yi Tay · Thomas Mensink · Alexander Kolesnikov · Filip Pavetic · Dustin Tran · Thomas Kipf · Mario Lucic · Xiaohua Zhai · Daniel Keysers · Jeremiah Harmsen · Neil Houlsby
  • 2023 Poster: Test-time Adaptation with Slot-Centric Models »
    Mihir Prabhudesai · Anirudh Goyal · Sujoy Paul · Sjoerd van Steenkiste · Mehdi S. M. Sajjadi · Gaurav Aggarwal · Thomas Kipf · Deepak Pathak · Katerina Fragkiadaki
  • 2020 : Invited Talk: Thomas Kipf »
    Thomas Kipf
  • 2019 Workshop: Learning and Reasoning with Graph-Structured Representations »
    Ethan Fetaya · Zhiting Hu · Thomas Kipf · Yujia Li · Xiaodan Liang · Renjie Liao · Raquel Urtasun · Hao Wang · Max Welling · Eric Xing · Richard Zemel
  • 2018 Poster: Neural Relational Inference for Interacting Systems »
    Thomas Kipf · Ethan Fetaya · Kuan-Chieh Wang · Max Welling · Richard Zemel
  • 2018 Oral: Neural Relational Inference for Interacting Systems »
    Thomas Kipf · Ethan Fetaya · Kuan-Chieh Wang · Max Welling · Richard Zemel