Self-Supervised Learning for Reasoning and Perception

Pengtao Xie, Shanghang Zhang, Ishan Misra, Pulkit Agrawal, Katerina Fragkiadaki, Ruisi Zhang, Tassilo Klein, Asli Celikyilmaz, Mihaela van der Schaar, Eric Xing


Self-supervised learning (SSL) is an unsupervised approach for representation learning without relying on human-provided labels. It creates auxiliary tasks on unlabeled input data and learns representations by solving these tasks. SSL has demonstrated great success on images, texts, robotics, etc. On a wide variety of tasks, SSL without using human-provided labels achieves performance that is close to fully supervised approaches. Existing SSL research mostly focuses on perception tasks such as image classification, speech recognition, text classification, etc. SSL for reasoning tasks (e.g., symbolic reasoning on graphs, relational reasoning in computer vision, multi-hop reasoning in NLP) is largely ignored. In this workshop, we aim to bridge this gap. We bring together SSL-interested researchers from various domains to discuss how to develop SSL methods for reasoning tasks, such as how to design pretext tasks for symbolic reasoning, how to develop contrastive learning methods for relational reasoning, how to develop SSL approaches to bridge reasoning and perception, etc. Different from previous SSL-related workshops which focus on perception tasks, our workshop focuses on promoting SSL research for reasoning.

Chat is not available.

Timezone: »


Sat 7:50 a.m. - 8:00 a.m.
Opening Remarks (Talk)   
Sat 8:00 a.m. - 8:30 a.m.
Invited talk #1: Professor Yoshua Bengio (Talk)   
Sat 8:30 a.m. - 9:00 a.m.
Invited talk #2: Professor Danqi Chen (Talk)   
Sat 9:00 a.m. - 9:30 a.m.
Invited talk #3: Professor Chelsea Finn (Talk)   
Sat 9:30 a.m. - 10:00 a.m.
Invited talk #4: Professor Pieter Abbeel (Talk)   
Sat 10:00 a.m. - 10:10 a.m.
Contributed Talk #1: Hongyu Ren (Talk)   
Sat 10:10 a.m. - 10:40 a.m.
Invited talk #5: Professor Abinav Gupta (Talk)   
Sat 10:40 a.m. - 11:10 a.m.
Invited talk #6: Professor Hanna Hajishirzi (Talk)   
Sat 11:10 a.m. - 11:50 a.m.
Poster Session I (Poster Session)
Sat 11:50 a.m. - 12:00 p.m.
Contributed Talk #2: Matko BoĆĄnjak (Talk)   
Sat 12:00 p.m. - 12:10 p.m.
Contributed Talk #3: Oleh Rybkin (Talk)   
Sat 12:10 p.m. - 12:20 p.m.
Contributed Talk #4: James Whittington (Talk)   
Sat 12:20 p.m. - 12:50 p.m.
Invited talk #7: Professor Jure Leskovec (Talk)   
Sat 12:50 p.m. - 1:20 p.m.
Invited talk #8: Professor Trevor Darrell (Talk)   
Sat 1:20 p.m. - 1:50 p.m.
Invited talk #9: Professor Sergey Levine (Talk)   
Sat 1:50 p.m. - 2:20 p.m.
Invited talk #10: Professor Ruslan Salakhutdinov (Talk)   
Sat 2:20 p.m. - 2:50 p.m.
Invited talk #11: Professor Stefano Ermon (Talk)   
Sat 2:50 p.m. - 3:20 p.m.
Invited talk #12: Professor Yizhou Sun (Talk)   
Sat 3:20 p.m. - 3:50 p.m.
Invited talk #13: Professor Nuno Vasconcelos (Talk)   
Sat 3:50 p.m. - 4:00 p.m.
Contributed Talk #5: Eltayeb K. E. Ahmed (Talk)   
Sat 4:00 p.m. - 5:10 p.m.
Poster Session II (Poster Session)
Sat 5:10 p.m. - 5:20 p.m.
Contributed Talk #6: Sihyun Yu (Talk)   
Sat 5:20 p.m. - 5:30 p.m.
Contributed Talk #7: Zhaoyu Li (Talk)   
Sat 5:30 p.m. - 6:00 p.m.
Invited talk #15: Professor Heng Ji (talk)