Workshop
Knowledge and Logical Reasoning in the Era of Data-driven Learning
Nezihe Merve G眉rel 路 Bo Li 路 Theodoros Rekatsinas 路 Beliz Gunel 路 Alberto Sngiovanni Vincentelli 路 Paroma Varma
Meeting Room 301
Fri 28 Jul, noon PDT
Thinking fast and automatic vs. slow and deliberate (respectively System I and II) is a popular analogy when comparing data-driven learning to the good old-fashion symbolic reasoning approaches. Underlying this analogy lies the different capabilities of both systems, or lack thereof. While data-driven learning (System I) has striking performance advantages over symbolic reasoning (System II), it lacks abilities such as abstraction, comprehensibility and contextual awareness. Symbolic reasoning, on the other hand, tackles those issues but tends to lag behind data-driven learning when it comes to speedy, efficient and automated decision-making. In the current state of matters to combat issues on both sides, there is an increasing consensus among the machine learning and artificial intelligence communities to draw out the best of both worlds and unify data-driven approaches with rule-based, symbolic, logical and commonsense reasoning. This workshop aims to discuss emerging advances and challenges on this topic, in particular at the intersection of data-driven paradigms and knowledge and logical reasoning. We focus on both directions of this intersection:
Knowledge and Logical Reasoning for Data-driven Learning: In this direction, we will investigate the role of rule-based, knowledge and logical reasoning to enable more deliberate and trustworthy data-driven learning.
Data-driven Learning for Knowledge and Logical Reasoning: In this reverse direction, we will explore the capabilities of data-driven approaches to derive knowledge, logical and commonsense reasoning from data.
Schedule
Fri 12:00 p.m. - 12:15 p.m.
|
Opening Remarks
(
Opening
)
>
SlidesLive Video |
Nezihe Merve G眉rel 馃敆 |
Fri 12:15 p.m. - 12:45 p.m.
|
Generalization on the Unseen, Logic Reasoning and Degree Curriculum
(
Invited Talk
)
>
SlidesLive Video |
Samy Bengio 馃敆 |
Fri 12:45 p.m. - 1:15 p.m.
|
AI can Learn from Data. But can it Learn to Reason?
(
Invited Talk
)
>
SlidesLive Video |
Guy Van den Broeck 馃敆 |
Fri 1:15 p.m. - 1:30 p.m.
|
ICML Coffee Break
|
馃敆 |
Fri 1:30 p.m. - 2:00 p.m.
|
Reasoning Biases in Language Models
(
Invited Talk
)
>
SlidesLive Video |
Ishita Dasgupta 馃敆 |
Fri 2:00 p.m. - 2:15 p.m.
|
Bayesian Neural Networks with Domain Knowledge
(
Contributed Talk
)
>
SlidesLive Video |
Dylan Sam 馃敆 |
Fri 2:15 p.m. - 2:30 p.m.
|
Neural Priority Queues for GNNs
(
Contributed Talk
)
>
SlidesLive Video |
Petar Veli膷kovi膰 馃敆 |
Fri 2:30 p.m. - 2:45 p.m.
|
Not All Neuro-Symbolic Concepts Are Created Equal: Analysis and Mitigation of Reasoning Shortcuts
(
Contributed Talk
)
>
SlidesLive Video |
Emanuele Marconato 馃敆 |
Fri 3:15 p.m. - 4:00 p.m.
|
Lunch Break
|
馃敆 |
Fri 4:00 p.m. - 4:30 p.m.
|
Avenging Polanyi's Revenge: Exploiting the Approximate Omniscience of LLMs in Planning without Deluding Yourself In the Process
(
Invited Talk
)
>
SlidesLive Video |
Subbarao Kambhampati 馃敆 |
Fri 4:30 p.m. - 5:00 p.m.
|
Concept Learning Across Domains and Modalities
(
Invited Talk
)
>
SlidesLive Video |
Jiajun Wu 馃敆 |
Fri 5:00 p.m. - 5:30 p.m.
|
Knowledge and Skill Acquisition through Language Model Pre-training and Instruction-tuning
(
Invited Talk
)
>
SlidesLive Video |
Xi Victoria Lin 馃敆 |
Fri 5:30 p.m. - 6:00 p.m.
|
Large Neural Models' Self-Learning Symbolic Knowledge
(
Invited Talk
)
>
SlidesLive Video |
馃敆 |
Fri 6:00 p.m. - 6:15 p.m.
|
ICML Coffee Break
|
馃敆 |
Fri 6:15 p.m. - 7:15 p.m.
|
Panel on Reasoning Capabilities of LLMs
(
Panel
)
>
SlidesLive Video |
Guy Van den Broeck 路 Ishita Dasgupta 路 Subbarao Kambhampati 路 Jiajun Wu 路 Xi Victoria Lin 路 Samy Bengio 路 Beliz Gunel 馃敆 |
Fri 7:15 p.m. - 7:55 p.m.
|
Poster Session 2
(
Poster Session
)
>
|
馃敆 |
Fri 7:55 p.m. - 8:00 p.m.
|
Closing Remarks
(
Remarks
)
>
|
馃敆 |
-
|
SQA3D: Situated Question Answering in 3D Scenes
(
Poster
)
>
|
Xiaojian Ma 路 Silong Yong 路 Zilong Zheng 路 Qing Li 路 Yitao Liang 路 Song-Chun Zhu 路 Siyuan Huang 馃敆 |
-
|
Retrieval-Augmented Multimodal Language Modeling
(
Poster
)
>
|
Michihiro Yasunaga 路 Armen Aghajanyan 路 Weijia Shi 路 Rich James 路 Jure Leskovec 路 Percy Liang 路 Mike Lewis 路 Luke Zettlemoyer 路 Wen-tau Yih 馃敆 |
-
|
On the Aggregation of Rules for Knowledge Graph Completion
(
Poster
)
>
|
Patrick Betz 路 Stefan L眉dtke 路 Christian Meilicke 路 Heiner Stuckenschmidt 馃敆 |
-
|
Large Language Model Programs
(
Poster
)
>
|
Imanol Schlag 路 Sainbayar Sukhbaatar 路 Asli Celikyilmaz 路 Wen-tau Yih 路 Jason Weston 路 J眉rgen Schmidhuber 路 Xian Li 馃敆 |
-
|
LeanDojo: Theorem Proving with Retrieval-Augmented Language Models
(
Poster
)
>
|
Kaiyu Yang 路 Aidan Swope 路 Alexander Gu 路 Rahul Chalamala 路 Shixing Yu 路 Saad Godil 路 Ryan Prenger 路 Animashree Anandkumar 馃敆 |
-
|
Semantically Adversarial Scene Generation with Explicit Knowledge Guidance for Autonomous Driving
(
Poster
)
>
|
Wenhao Ding 路 Haohong Lin 路 Bo Li 路 Ding Zhao 馃敆 |
-
|
Towards true discovery of the differential equations ( Poster ) > link | Alexander Hvatov 路 Roman Titov 馃敆 |
-
|
VAEL: Bridging Variational Autoencoders and Probabilistic Logic Programming
(
Poster
)
>
|
Eleonora Misino 路 Giuseppe Marra 路 Emanuele Sansone 馃敆 |
-
|
Explanatory Learning: Towards Artificial Scientific Discovery
(
Poster
)
>
|
Antonio Norelli 路 Giorgio Mariani 路 Luca Moschella 路 Andrea Santilli 路 Giambattista Parascandolo 路 Simone Melzi 路 Emanuele Rodola 馃敆 |
-
|
A*Net: A Scalable Path-based Reasoning Approach for Knowledge Graphs
(
Poster
)
>
|
Zhaocheng Zhu 路 Xinyu Yuan 路 Mikhail Galkin 路 Louis-Pascal Xhonneux 路 Ming Zhang 路 Maxime Gazeau 路 Jian Tang 馃敆 |
-
|
Neuro-Symbolic Continual Learning: Knowledge, Reasoning Shortcuts and Concept Rehearsal
(
Poster
)
>
|
Emanuele Marconato 路 Gianpaolo Bontempo 路 ELISA FICARRA 路 Simone Calderara 路 Andrea Passerini 路 Stefano Teso 馃敆 |
-
|
Modeling Human Few-Shot Learning using Bayesian Inference over Natural Language
(
Poster
)
>
|
Kevin Ellis 馃敆 |
-
|
DiversiGATE: A Comprehensive Framework for Reliable Large Language Models
(
Poster
)
>
|
Shima Imani 路 Ali Beyram 路 Harsh Shrivastava 馃敆 |
-
|
OC-NMN: Object-centric Compositional Neural Module Network for Generative Visual Analogical Reasoning
(
Poster
)
>
|
Rim Assouel 路 Pau Rodriguez 路 Perouz Taslakian 路 David Vazquez 路 Yoshua Bengio 馃敆 |
-
|
Look, Remember and Reason: Visual Reasoning with Grounded Rationales
(
Poster
)
>
|
Apratim Bhattacharyya 路 Sunny Panchal 路 Reza Pourreza 路 Pulkit Madan 路 Mingu Lee 路 Roland Memisevic 馃敆 |
-
|
Describe, Explain, Plan and Select: Interactive Planning with LLMs Enables Open-World Multi-Task Agents
(
Poster
)
>
|
Zihao Wang 路 Shaofei Cai 路 Guanzhou Chen 路 Anji Liu 路 Xiaojian Ma 路 Yitao Liang 馃敆 |
-
|
Recursive Algorithmic Reasoning ( Poster ) > link | Dulhan Jayalath 路 Jonas J眉r脽 路 Petar Veli膷kovi膰 馃敆 |
-
|
EXPLAIN, AGREE and LEARN: A Recipe for Scalable Neural-Symbolic Learning
(
Poster
)
>
|
Victor Verreet 路 Lennert De Smet 路 Emanuele Sansone 馃敆 |
-
|
Semantic Conditioning at Inference : Improving Neural-based Systems with Logical Background Knowledge
(
Poster
)
>
|
Arthur Ledaguenel 路 C茅line Hudelot 路 Mostepha Khouadjia 馃敆 |
-
|
Continuous-Discrete Message Passing for Graph Logic Reasoning
(
Poster
)
>
|
Crist贸bal Corval谩n Morbiducci 路 Francesco Alesiani 路 Markus Zopf 馃敆 |
-
|
Testing the General Deductive Reasoning Capacity of Large Language Models Using OOD Examples
(
Poster
)
>
|
Abulhair Saparov 路 Richard Yuanzhe Pang 路 Vishakh Padmakumar 路 Nitish Joshi 路 Seyed Mehran Kazemi 路 Najoung Kim 路 He He 馃敆 |
-
|
Evidence of Meaning in Language Models Trained on Programs
(
Poster
)
>
|
Charles Jin 路 Martin Rinard 馃敆 |
-
|
Neurosymbolic AI for Reasoning on Biomedical Knowledge Graphs
(
Poster
)
>
|
Lauren Nicole DeLong 路 Ramon Fern谩ndez Mir 路 Zonglin Ji 路 Fiona Niamh Coulter Smith 路 Jacques D. Fleuriot 馃敆 |
-
|
Neural Priority Queues for GNNs
(
Poster
)
>
|
Rishabh Jain 路 Petar Veli膷kovi膰 路 Pietro Li贸 馃敆 |
-
|
Exposing Attention Glitches with Flip-Flop Language Modeling
(
Poster
)
>
|
Bingbin Liu 路 Jordan Ash 路 Surbhi Goel 路 Akshay Krishnamurthy 路 Cyril Zhang 馃敆 |
-
|
Does End-to-End Visual Pretraining Help Reasoning?
(
Poster
)
>
|
Chen Sun 路 Calvin Luo 路 Xingyi Zhou 路 Anurag Arnab 路 Cordelia Schmid 馃敆 |
-
|
On the Planning Abilities of Large Language Models - A Critical Investigation
(
Poster
)
>
|
Karthik Valmeekam 路 Matthew Marquez 路 Sarath Sreedharan 路 Subbarao Kambhampati 馃敆 |
-
|
Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task Planning
(
Poster
)
>
|
Lin Guan 路 Karthik Valmeekam 路 Sarath Sreedharan 路 Subbarao Kambhampati 馃敆 |
-
|
On The Ability of Transformers To Learn Recursive Patterns
(
Poster
)
>
|
Dylan Zhang 路 Curt Tigges 路 Talia Ringer 路 Stella Biderman 路 Maxim Raginsky 馃敆 |
-
|
Reasoning Ability Emerges in Large Language Models as Aggregation of Reasoning Paths
(
Poster
)
>
|
Xinyi Wang 路 William Wang 馃敆 |
-
|
Exploring the Impact of Disentangling Extraction and Reasoning in Multi-hop Spatial Reasoning
(
Poster
)
>
|
Roshanak Mirzaee 路 Parisa Kordjamshidi 馃敆 |
-
|
Plan, Eliminate, and Track --- Language Models are Good Teachers for Embodied Agents.
(
Poster
)
>
|
Yue Wu 路 So Yeon Min 路 Yonatan Bisk 路 Ruslan Salakhutdinov 路 Amos Azaria 路 Yuanzhi Li 路 Tom Mitchell 路 Shrimai Prabhumoye 馃敆 |
-
|
SPRING: Studying Papers and Reasoning to play Games
(
Poster
)
>
|
Yue Wu 路 Shrimai Prabhumoye 路 So Yeon Min 路 Yonatan Bisk 路 Ruslan Salakhutdinov 路 Amos Azaria 路 Tom Mitchell 路 Yuanzhi Li 馃敆 |
-
|
Not All Neuro-Symbolic Concepts Are Created Equal: Analysis and Mitigation of Reasoning Shortcuts
(
Poster
)
>
|
Emanuele Marconato 路 Stefano Teso 路 Antonio Vergari 路 Andrea Passerini 馃敆 |
-
|
Parallel Algorithms Align with Neural Execution
(
Poster
)
>
|
Valerie Engelmayer 路 Dobrik Georgiev 路 Petar Veli膷kovi膰 馃敆 |
-
|
Learning and Leveraging Verifiers to Improve Planning Capabilities of Pre-trained Language Models
(
Poster
)
>
|
Daman Arora 路 Subbarao Kambhampati 馃敆 |
-
|
Latent Space Representations of Neural Algorithmic Reasoners
(
Poster
)
>
|
Vladimir V. Mirjani膰 路 Razvan Pascanu 路 Petar Veli膷kovi膰 馃敆 |
-
|
Addressing Descrepancies in Semantic and Visual Alignment in Neural Networks
(
Poster
)
>
|
Natalie Abreu 路 Nathan Vaska 路 Victoria Helus 馃敆 |
-
|
Evaluating the Capabilities of Multi-modal Reasoning Models with Synthetic Task Data
(
Poster
)
>
|
Nathan Vaska 路 Victoria Helus 馃敆 |
-
|
Towards More Likely Models for AI Planning
(
Poster
)
>
|
Turgay Caglar 路 sirine belhaj 路 Tathagata Chakraborti 路 Michael Katz 路 Sarath Sreedharan 馃敆 |
-
|
A Pseudo-Semantic Loss for Deep Generative Models with Logical Constraints
(
Poster
)
>
|
Kareem Ahmed 路 Kai-Wei Chang 路 Guy Van den Broeck 馃敆 |
-
|
Asynchronous Algorithmic Alignment with Cocycles
(
Poster
)
>
|
Andrew Dudzik 路 Tamara von Glehn 路 Razvan Pascanu 路 Petar Veli膷kovi膰 馃敆 |
-
|
Learning with Explanation Constraints
(
Poster
)
>
|
Rattana Pukdee 路 Dylan Sam 路 Nina Balcan 路 Pradeep Ravikumar 馃敆 |
-
|
BoardgameQA: Natural Language Reasoning with Contradictory Information
(
Poster
)
>
|
Mehran Kazemi 路 Quan Yuan 路 Deepti Bhatia 路 Najoung Kim 路 Xin Xu 路 Vaiva Imbrasaite 路 Deepak Ramachandran 馃敆 |
-
|
Invalid Logic, Equivalent Gains: The Bizarreness of Reasoning in Language Model Prompting
(
Poster
)
>
|
Rylan Schaeffer 路 Kateryna Pistunova 路 Samar Khanna 路 Sarthak Consul 路 Sanmi Koyejo 馃敆 |
-
|
(Un)interpretability of Transformers: a case study with Dyck grammars
(
Poster
)
>
|
Kaiyue Wen 路 Yuchen Li 路 Bingbin Liu 路 Andrej Risteski 馃敆 |
-
|
dPASP: A Comprehensive Differentiable Probabilistic Answer Set Programming Environment For Neurosymbolic Learning and Reasoning
(
Poster
)
>
|
Renato Geh 路 Jonas Goncalves 路 Igor Silveira 路 Denis D Maua 路 Fabio Cozman 馃敆 |
-
|
Building One-class Detector for Anything: Open-vocabulary Zero-shot OOD Detection Using Text-image Models ( Poster ) > link | Yunhao Ge 路 Jie Ren 路 Jiaping Zhao 路 Kaifeng Chen 路 Andrew Gallagher 路 Laurent Itti 路 Balaji Lakshminarayanan 馃敆 |
-
|
Bayesian Neural Networks with Domain Knowledge
(
Poster
)
>
|
Dylan Sam 路 Rattana Pukdee 路 Daniel Jeong 路 Yewon Byun 路 Zico Kolter 馃敆 |
-
|
A Model-Theoretic Approach to Natural Language Inference
(
Poster
)
>
|
Dennis Tang 馃敆 |
-
|
Disaster Occurrence Detection through GNN Models using Disaster Knowledge Graphs
(
Poster
)
>
|
Seonhyeong Kim 路 Irshad Khan 路 Young-Woo Kwon 馃敆 |
-
|
Chain of Thought Empowers Transformers to Solve Inherently Serial Problems
(
Poster
)
>
|
Zhiyuan Li 路 Hong Liu 路 Denny Zhou 路 Tengyu Ma 馃敆 |
-
|
Open Visual Knowledge Extraction via Relation-Oriented Multimodality Model Prompting
(
Poster
)
>
|
Hejie Cui 路 Xinyu Fang 路 Zihan Zhang 路 Ran Xu 路 Xuan Kan 路 Xin Liu 路 Manling Li 路 Yangqiu Song 路 Carl Yang 馃敆 |
-
|
Towards A Unified Neural Architecture for Visual Recognition and Reasoning
(
Poster
)
>
|
Calvin Luo 路 Boqing Gong 路 Ting Chen 路 Chen Sun 馃敆 |
-
|
How Do Transformers Learn Topic Structure: Towards a Mechanistic Understanding
(
Poster
)
>
|
Yuchen Li 路 Yuanzhi Li 路 Andrej Risteski 馃敆 |
-
|
Large Language Models are Zero-Shot Multi-Tool Users
(
Poster
)
>
|
Luca Beurer-Kellner 路 Marc Fischer 路 Martin Vechev 馃敆 |
-
|
Training LLMs with Noisy Algorithmic Chain of Thought
(
Poster
)
>
|
Alex Havrilla 馃敆 |
-
|
The Role of Semantic Parsing in Understanding Procedural Text
(
Poster
)
>
|
Hossein Rajaby Faghihi 路 Parisa Kordjamshidi 路 Choh Man Teng 路 James Allen 馃敆 |
-
|
Partial Label Learning meets Active Learning: Enhancing Annotation Efficiency through Binary Questioning
(
Poster
)
>
|
Shivangana Rawat 路 Chaitanya Devaguptapu 路 Vineeth Balasubramanian 馃敆 |
-
|
Learning to Initiate and Reason in Event-Driven Cascading Processes
(
Poster
)
>
|
Yuval Atzmon 路 Eli Meirom 路 Shie Mannor 路 Gal Chechik 馃敆 |
-
|
LLM-grounded Text-to-Image Diffusion Models ( Poster ) > link | Long (Tony) Lian 路 Boyi Li 路 Adam Yala 路 Trevor Darrell 馃敆 |
-
|
Language Models Can Improve Event Prediction by Few-Shot Abductive Reasoning
(
Poster
)
>
|
Xiaoming Shi 路 Siqiao Xue 路 Kangrui Wang 路 Fan Zhou 路 James Zhang 路 Jun Zhou 路 Chenhao Tan 路 Hongyuan Mei 馃敆 |
-
|
What鈥檚 left can鈥檛 be right - The remaining positional incompetence of contrastive vision-language models
(
Poster
)
>
|
Nils Hoehing 路 Ellen Rushe 路 Anthony Ventresque 馃敆 |
-
|
Deep Neuro-Symbolic Weight Learning in Neural Probabilistic Soft Logic
(
Poster
)
>
|
Connor Pryor 路 Charles Dickens 路 Lise Getoor 馃敆 |
-
|
Equivariance Is Not All You Need: Characterizing the Utility of Equivariant Graph Neural Networks for Particle Physics Tasks
(
Poster
)
>
|
Savannah Thais 路 Daniel Murnane 馃敆 |
-
|
Revealing the Intrinsic Ability of Generative Language Models in Relation Prediction
(
Poster
)
>
|
Qi Li 路 Lyuwen Wu 路 Luoyi Fu 路 Xinbing Wang 路 SHIYU LIANG 馃敆 |
-
|
Augmenting the Knowledge to Large Model from Federated Small Models
(
Poster
)
>
|
Miru Kim 路 Minhae Kwon 馃敆 |
-
|
Explicit Planning Helps Language Models in Logical Reasoning
(
Poster
)
>
|
Hongyu Zhao 路 Kangrui Wang 路 Mo Yu 路 Hongyuan Mei 馃敆 |
-
|
Evaluating the Casual Reasoning Abilities of Large Language Models ( Poster ) > link | Isha Puri 路 Hima Lakkaraju 馃敆 |