Workshop
Knowledge and Logical Reasoning in the Era of Data-driven Learning
Nezihe Merve Gürel · Bo Li · Theodoros Rekatsinas · Beliz Gunel · Alberto Sngiovanni Vincentelli · Paroma Varma
Meeting Room 301
Fri 28 Jul, noon PDT
Thinking fast and automatic vs. slow and deliberate (respectively System I and II) is a popular analogy when comparing data-driven learning to the good old-fashion symbolic reasoning approaches. Underlying this analogy lies the different capabilities of both systems, or lack thereof. While data-driven learning (System I) has striking performance advantages over symbolic reasoning (System II), it lacks abilities such as abstraction, comprehensibility and contextual awareness. Symbolic reasoning, on the other hand, tackles those issues but tends to lag behind data-driven learning when it comes to speedy, efficient and automated decision-making. In the current state of matters to combat issues on both sides, there is an increasing consensus among the machine learning and artificial intelligence communities to draw out the best of both worlds and unify data-driven approaches with rule-based, symbolic, logical and commonsense reasoning. This workshop aims to discuss emerging advances and challenges on this topic, in particular at the intersection of data-driven paradigms and knowledge and logical reasoning. We focus on both directions of this intersection:
Knowledge and Logical Reasoning for Data-driven Learning: In this direction, we will investigate the role of rule-based, knowledge and logical reasoning to enable more deliberate and trustworthy data-driven learning.
Data-driven Learning for Knowledge and Logical Reasoning: In this reverse direction, we will explore the capabilities of data-driven approaches to derive knowledge, logical and commonsense reasoning from data.
Schedule
Fri 12:00 p.m. - 12:15 p.m.
|
Opening Remarks
(
Opening
)
>
SlidesLive Video |
Nezihe Merve Gürel 🔗 |
Fri 12:15 p.m. - 12:45 p.m.
|
Generalization on the Unseen, Logic Reasoning and Degree Curriculum
(
Invited Talk
)
>
SlidesLive Video |
Samy Bengio 🔗 |
Fri 12:45 p.m. - 1:15 p.m.
|
AI can Learn from Data. But can it Learn to Reason?
(
Invited Talk
)
>
SlidesLive Video |
Guy Van den Broeck 🔗 |
Fri 1:15 p.m. - 1:30 p.m.
|
ICML Coffee Break
|
🔗 |
Fri 1:30 p.m. - 2:00 p.m.
|
Reasoning Biases in Language Models
(
Invited Talk
)
>
SlidesLive Video |
Ishita Dasgupta 🔗 |
Fri 2:00 p.m. - 2:15 p.m.
|
Bayesian Neural Networks with Domain Knowledge
(
Contributed Talk
)
>
SlidesLive Video |
Dylan Sam 🔗 |
Fri 2:15 p.m. - 2:30 p.m.
|
Neural Priority Queues for GNNs
(
Contributed Talk
)
>
SlidesLive Video |
Petar Veličković 🔗 |
Fri 2:30 p.m. - 2:45 p.m.
|
Not All Neuro-Symbolic Concepts Are Created Equal: Analysis and Mitigation of Reasoning Shortcuts
(
Contributed Talk
)
>
SlidesLive Video |
Emanuele Marconato 🔗 |
Fri 3:15 p.m. - 4:00 p.m.
|
Lunch Break
|
🔗 |
Fri 4:00 p.m. - 4:30 p.m.
|
Avenging Polanyi's Revenge: Exploiting the Approximate Omniscience of LLMs in Planning without Deluding Yourself In the Process
(
Invited Talk
)
>
SlidesLive Video |
Subbarao Kambhampati 🔗 |
Fri 4:30 p.m. - 5:00 p.m.
|
Concept Learning Across Domains and Modalities
(
Invited Talk
)
>
SlidesLive Video |
Jiajun Wu 🔗 |
Fri 5:00 p.m. - 5:30 p.m.
|
Knowledge and Skill Acquisition through Language Model Pre-training and Instruction-tuning
(
Invited Talk
)
>
SlidesLive Video |
Xi Victoria Lin 🔗 |
Fri 5:30 p.m. - 6:00 p.m.
|
Large Neural Models' Self-Learning Symbolic Knowledge
(
Invited Talk
)
>
SlidesLive Video |
🔗 |
Fri 6:00 p.m. - 6:15 p.m.
|
ICML Coffee Break
|
🔗 |
Fri 6:15 p.m. - 7:15 p.m.
|
Panel on Reasoning Capabilities of LLMs
(
Panel
)
>
SlidesLive Video |
Guy Van den Broeck · Ishita Dasgupta · Subbarao Kambhampati · Jiajun Wu · Xi Victoria Lin · Samy Bengio · Beliz Gunel 🔗 |
Fri 7:15 p.m. - 7:55 p.m.
|
Poster Session 2
(
Poster Session
)
>
|
🔗 |
Fri 7:55 p.m. - 8:00 p.m.
|
Closing Remarks
(
Remarks
)
>
|
🔗 |
-
|
SQA3D: Situated Question Answering in 3D Scenes
(
Poster
)
>
|
Xiaojian Ma · Silong Yong · Zilong Zheng · Qing Li · Yitao Liang · Song-Chun Zhu · Siyuan Huang 🔗 |
-
|
Retrieval-Augmented Multimodal Language Modeling
(
Poster
)
>
|
Michihiro Yasunaga · Armen Aghajanyan · Weijia Shi · Rich James · Jure Leskovec · Percy Liang · Mike Lewis · Luke Zettlemoyer · Wen-tau Yih 🔗 |
-
|
On the Aggregation of Rules for Knowledge Graph Completion
(
Poster
)
>
|
Patrick Betz · Stefan Lüdtke · Christian Meilicke · Heiner Stuckenschmidt 🔗 |
-
|
Large Language Model Programs
(
Poster
)
>
|
Imanol Schlag · Sainbayar Sukhbaatar · Asli Celikyilmaz · Wen-tau Yih · Jason Weston · Jürgen Schmidhuber · Xian Li 🔗 |
-
|
LeanDojo: Theorem Proving with Retrieval-Augmented Language Models
(
Poster
)
>
|
Kaiyu Yang · Aidan Swope · Alexander Gu · Rahul Chalamala · Shixing Yu · Saad Godil · Ryan Prenger · Animashree Anandkumar 🔗 |
-
|
Semantically Adversarial Scene Generation with Explicit Knowledge Guidance for Autonomous Driving
(
Poster
)
>
|
Wenhao Ding · Haohong Lin · Bo Li · Ding Zhao 🔗 |
-
|
Towards true discovery of the differential equations ( Poster ) > link | Alexander Hvatov · Roman Titov 🔗 |
-
|
VAEL: Bridging Variational Autoencoders and Probabilistic Logic Programming
(
Poster
)
>
|
Eleonora Misino · Giuseppe Marra · Emanuele Sansone 🔗 |
-
|
Explanatory Learning: Towards Artificial Scientific Discovery
(
Poster
)
>
|
Antonio Norelli · Giorgio Mariani · Luca Moschella · Andrea Santilli · Giambattista Parascandolo · Simone Melzi · Emanuele Rodola 🔗 |
-
|
A*Net: A Scalable Path-based Reasoning Approach for Knowledge Graphs
(
Poster
)
>
|
Zhaocheng Zhu · Xinyu Yuan · Mikhail Galkin · Louis-Pascal Xhonneux · Ming Zhang · Maxime Gazeau · Jian Tang 🔗 |
-
|
Neuro-Symbolic Continual Learning: Knowledge, Reasoning Shortcuts and Concept Rehearsal
(
Poster
)
>
|
Emanuele Marconato · Gianpaolo Bontempo · ELISA FICARRA · Simone Calderara · Andrea Passerini · Stefano Teso 🔗 |
-
|
Modeling Human Few-Shot Learning using Bayesian Inference over Natural Language
(
Poster
)
>
|
Kevin Ellis 🔗 |
-
|
DiversiGATE: A Comprehensive Framework for Reliable Large Language Models
(
Poster
)
>
|
Shima Imani · Ali Beyram · Harsh Shrivastava 🔗 |
-
|
OC-NMN: Object-centric Compositional Neural Module Network for Generative Visual Analogical Reasoning
(
Poster
)
>
|
Rim Assouel · Pau Rodriguez · Perouz Taslakian · David Vazquez · Yoshua Bengio 🔗 |
-
|
Look, Remember and Reason: Visual Reasoning with Grounded Rationales
(
Poster
)
>
|
Apratim Bhattacharyya · Sunny Panchal · Reza Pourreza · Pulkit Madan · Mingu Lee · Roland Memisevic 🔗 |
-
|
Describe, Explain, Plan and Select: Interactive Planning with LLMs Enables Open-World Multi-Task Agents
(
Poster
)
>
|
Zihao Wang · Shaofei Cai · Guanzhou Chen · Anji Liu · Xiaojian Ma · Yitao Liang 🔗 |
-
|
Recursive Algorithmic Reasoning ( Poster ) > link | Dulhan Jayalath · Jonas Jürß · Petar Veličković 🔗 |
-
|
EXPLAIN, AGREE and LEARN: A Recipe for Scalable Neural-Symbolic Learning
(
Poster
)
>
|
Victor Verreet · Lennert De Smet · Emanuele Sansone 🔗 |
-
|
Semantic Conditioning at Inference : Improving Neural-based Systems with Logical Background Knowledge
(
Poster
)
>
|
Arthur Ledaguenel · Céline Hudelot · Mostepha Khouadjia 🔗 |
-
|
Continuous-Discrete Message Passing for Graph Logic Reasoning
(
Poster
)
>
|
Cristóbal Corvalán Morbiducci · Francesco Alesiani · Markus Zopf 🔗 |
-
|
Testing the General Deductive Reasoning Capacity of Large Language Models Using OOD Examples
(
Poster
)
>
|
Abulhair Saparov · Richard Yuanzhe Pang · Vishakh Padmakumar · Nitish Joshi · Seyed Mehran Kazemi · Najoung Kim · He He 🔗 |
-
|
Evidence of Meaning in Language Models Trained on Programs
(
Poster
)
>
|
Charles Jin · Martin Rinard 🔗 |
-
|
Neurosymbolic AI for Reasoning on Biomedical Knowledge Graphs
(
Poster
)
>
|
Lauren Nicole DeLong · Ramon Fernández Mir · Zonglin Ji · Fiona Niamh Coulter Smith · Jacques D. Fleuriot 🔗 |
-
|
Neural Priority Queues for GNNs
(
Poster
)
>
|
Rishabh Jain · Petar Veličković · Pietro Lió 🔗 |
-
|
Exposing Attention Glitches with Flip-Flop Language Modeling
(
Poster
)
>
|
Bingbin Liu · Jordan Ash · Surbhi Goel · Akshay Krishnamurthy · Cyril Zhang 🔗 |
-
|
Does End-to-End Visual Pretraining Help Reasoning?
(
Poster
)
>
|
Chen Sun · Calvin Luo · Xingyi Zhou · Anurag Arnab · Cordelia Schmid 🔗 |
-
|
On the Planning Abilities of Large Language Models - A Critical Investigation
(
Poster
)
>
|
Karthik Valmeekam · Matthew Marquez · Sarath Sreedharan · Subbarao Kambhampati 🔗 |
-
|
Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task Planning
(
Poster
)
>
|
Lin Guan · Karthik Valmeekam · Sarath Sreedharan · Subbarao Kambhampati 🔗 |
-
|
On The Ability of Transformers To Learn Recursive Patterns
(
Poster
)
>
|
Dylan Zhang · Curt Tigges · Talia Ringer · Stella Biderman · Maxim Raginsky 🔗 |
-
|
Reasoning Ability Emerges in Large Language Models as Aggregation of Reasoning Paths
(
Poster
)
>
|
Xinyi Wang · William Wang 🔗 |
-
|
Exploring the Impact of Disentangling Extraction and Reasoning in Multi-hop Spatial Reasoning
(
Poster
)
>
|
Roshanak Mirzaee · Parisa Kordjamshidi 🔗 |
-
|
Plan, Eliminate, and Track --- Language Models are Good Teachers for Embodied Agents.
(
Poster
)
>
|
Yue Wu · So Yeon Min · Yonatan Bisk · Ruslan Salakhutdinov · Amos Azaria · Yuanzhi Li · Tom Mitchell · Shrimai Prabhumoye 🔗 |
-
|
SPRING: Studying Papers and Reasoning to play Games
(
Poster
)
>
|
Yue Wu · Shrimai Prabhumoye · So Yeon Min · Yonatan Bisk · Ruslan Salakhutdinov · Amos Azaria · Tom Mitchell · Yuanzhi Li 🔗 |
-
|
Not All Neuro-Symbolic Concepts Are Created Equal: Analysis and Mitigation of Reasoning Shortcuts
(
Poster
)
>
|
Emanuele Marconato · Stefano Teso · Antonio Vergari · Andrea Passerini 🔗 |
-
|
Parallel Algorithms Align with Neural Execution
(
Poster
)
>
|
Valerie Engelmayer · Dobrik Georgiev · Petar Veličković 🔗 |
-
|
Learning and Leveraging Verifiers to Improve Planning Capabilities of Pre-trained Language Models
(
Poster
)
>
|
Daman Arora · Subbarao Kambhampati 🔗 |
-
|
Latent Space Representations of Neural Algorithmic Reasoners
(
Poster
)
>
|
Vladimir V. Mirjanić · Razvan Pascanu · Petar Veličković 🔗 |
-
|
Addressing Descrepancies in Semantic and Visual Alignment in Neural Networks
(
Poster
)
>
|
Natalie Abreu · Nathan Vaska · Victoria Helus 🔗 |
-
|
Evaluating the Capabilities of Multi-modal Reasoning Models with Synthetic Task Data
(
Poster
)
>
|
Nathan Vaska · Victoria Helus 🔗 |
-
|
Towards More Likely Models for AI Planning
(
Poster
)
>
|
Turgay Caglar · sirine belhaj · Tathagata Chakraborti · Michael Katz · Sarath Sreedharan 🔗 |
-
|
A Pseudo-Semantic Loss for Deep Generative Models with Logical Constraints
(
Poster
)
>
|
Kareem Ahmed · Kai-Wei Chang · Guy Van den Broeck 🔗 |
-
|
Asynchronous Algorithmic Alignment with Cocycles
(
Poster
)
>
|
Andrew Dudzik · Tamara von Glehn · Razvan Pascanu · Petar Veličković 🔗 |
-
|
Learning with Explanation Constraints
(
Poster
)
>
|
Rattana Pukdee · Dylan Sam · Nina Balcan · Pradeep Ravikumar 🔗 |
-
|
BoardgameQA: Natural Language Reasoning with Contradictory Information
(
Poster
)
>
|
Mehran Kazemi · Quan Yuan · Deepti Bhatia · Najoung Kim · Xin Xu · Vaiva Imbrasaite · Deepak Ramachandran 🔗 |
-
|
Invalid Logic, Equivalent Gains: The Bizarreness of Reasoning in Language Model Prompting
(
Poster
)
>
|
Rylan Schaeffer · Kateryna Pistunova · Samar Khanna · Sarthak Consul · Sanmi Koyejo 🔗 |
-
|
(Un)interpretability of Transformers: a case study with Dyck grammars
(
Poster
)
>
|
Kaiyue Wen · Yuchen Li · Bingbin Liu · Andrej Risteski 🔗 |
-
|
dPASP: A Comprehensive Differentiable Probabilistic Answer Set Programming Environment For Neurosymbolic Learning and Reasoning
(
Poster
)
>
|
Renato Geh · Jonas Goncalves · Igor Silveira · Denis D Maua · Fabio Cozman 🔗 |
-
|
Building One-class Detector for Anything: Open-vocabulary Zero-shot OOD Detection Using Text-image Models ( Poster ) > link | Yunhao Ge · Jie Ren · Jiaping Zhao · Kaifeng Chen · Andrew Gallagher · Laurent Itti · Balaji Lakshminarayanan 🔗 |
-
|
Bayesian Neural Networks with Domain Knowledge
(
Poster
)
>
|
Dylan Sam · Rattana Pukdee · Daniel Jeong · Yewon Byun · Zico Kolter 🔗 |
-
|
A Model-Theoretic Approach to Natural Language Inference
(
Poster
)
>
|
Dennis Tang 🔗 |
-
|
Disaster Occurrence Detection through GNN Models using Disaster Knowledge Graphs
(
Poster
)
>
|
Seonhyeong Kim · Irshad Khan · Young-Woo Kwon 🔗 |
-
|
Chain of Thought Empowers Transformers to Solve Inherently Serial Problems
(
Poster
)
>
|
Zhiyuan Li · Hong Liu · Denny Zhou · Tengyu Ma 🔗 |
-
|
Open Visual Knowledge Extraction via Relation-Oriented Multimodality Model Prompting
(
Poster
)
>
|
Hejie Cui · Xinyu Fang · Zihan Zhang · Ran Xu · Xuan Kan · Xin Liu · Manling Li · Yangqiu Song · Carl Yang 🔗 |
-
|
Towards A Unified Neural Architecture for Visual Recognition and Reasoning
(
Poster
)
>
|
Calvin Luo · Boqing Gong · Ting Chen · Chen Sun 🔗 |
-
|
How Do Transformers Learn Topic Structure: Towards a Mechanistic Understanding
(
Poster
)
>
|
Yuchen Li · Yuanzhi Li · Andrej Risteski 🔗 |
-
|
Large Language Models are Zero-Shot Multi-Tool Users
(
Poster
)
>
|
Luca Beurer-Kellner · Marc Fischer · Martin Vechev 🔗 |
-
|
Training LLMs with Noisy Algorithmic Chain of Thought
(
Poster
)
>
|
Alex Havrilla 🔗 |
-
|
The Role of Semantic Parsing in Understanding Procedural Text
(
Poster
)
>
|
Hossein Rajaby Faghihi · Parisa Kordjamshidi · Choh Man Teng · James Allen 🔗 |
-
|
Partial Label Learning meets Active Learning: Enhancing Annotation Efficiency through Binary Questioning
(
Poster
)
>
|
Shivangana Rawat · Chaitanya Devaguptapu · Vineeth Balasubramanian 🔗 |
-
|
Learning to Initiate and Reason in Event-Driven Cascading Processes
(
Poster
)
>
|
Yuval Atzmon · Eli Meirom · Shie Mannor · Gal Chechik 🔗 |
-
|
LLM-grounded Text-to-Image Diffusion Models ( Poster ) > link | Long (Tony) Lian · Boyi Li · Adam Yala · Trevor Darrell 🔗 |
-
|
Language Models Can Improve Event Prediction by Few-Shot Abductive Reasoning
(
Poster
)
>
|
Xiaoming Shi · Siqiao Xue · Kangrui Wang · Fan Zhou · James Zhang · Jun Zhou · Chenhao Tan · Hongyuan Mei 🔗 |
-
|
What’s left can’t be right - The remaining positional incompetence of contrastive vision-language models
(
Poster
)
>
|
Nils Hoehing · Ellen Rushe · Anthony Ventresque 🔗 |
-
|
Deep Neuro-Symbolic Weight Learning in Neural Probabilistic Soft Logic
(
Poster
)
>
|
Connor Pryor · Charles Dickens · Lise Getoor 🔗 |
-
|
Equivariance Is Not All You Need: Characterizing the Utility of Equivariant Graph Neural Networks for Particle Physics Tasks
(
Poster
)
>
|
Savannah Thais · Daniel Murnane 🔗 |
-
|
Revealing the Intrinsic Ability of Generative Language Models in Relation Prediction
(
Poster
)
>
|
Qi Li · Lyuwen Wu · Luoyi Fu · Xinbing Wang · SHIYU LIANG 🔗 |
-
|
Augmenting the Knowledge to Large Model from Federated Small Models
(
Poster
)
>
|
Miru Kim · Minhae Kwon 🔗 |
-
|
Explicit Planning Helps Language Models in Logical Reasoning
(
Poster
)
>
|
Hongyu Zhao · Kangrui Wang · Mo Yu · Hongyuan Mei 🔗 |
-
|
Evaluating the Casual Reasoning Abilities of Large Language Models ( Poster ) > link | Isha Puri · Hima Lakkaraju 🔗 |