Timezone: »

Neuro-Symbolic Hierarchical Rule Induction
Claire Glanois · Zhaohui Jiang · Xuening Feng · Paul Weng · Matthieu Zimmer · Dong Li · Wulong Liu · Jianye Hao

Thu Jul 21 03:00 PM -- 05:00 PM (PDT) @ Hall E #203

We propose Neuro-Symbolic Hierarchical Rule Induction (HRI), an efficient interpretable neuro-symbolic model, to solve Inductive Logic Programming (ILP) problems. In this model, which is built from a pre-defined set of meta-rules organized in a hierarchical structure, first-order rules are invented by learning embeddings to match facts and body predicates of a meta-rule. To instantiate HRI, we specifically design an expressive set of generic meta-rules, and demonstrate they generate a consequent fragment of Horn clauses. As a differentiable model, HRI can be trained both via supervised learning and reinforcement learning. To converge to interpretable rules, we inject a controlled noise to avoid local optima and employ an interpretability-regularization term. We empirically validate our model on various tasks (ILP, visual genome, reinforcement learning) against relevant state-of-the-art methods, including traditional ILP methods and neuro-symbolic models.

Author Information

Claire Glanois (IT University Copenhagen)
Zhaohui Jiang (Shanghai Jiao Tong University)
Xuening Feng (Shanghai Jiao Tong University)
Paul Weng (Shanghai Jiao Tong University)
Matthieu Zimmer (Shanghai Jiao Tong University)

[Actively looking for a research scientist position.] Matthieu Zimmer received the Ph.D. degree in computer science in 2018 from the University of Lorraine and the M.S. degree in computer science from the University Pierre and Marie Curie in 2014. Since 2018, he is a postdoctoral researcher at the joint institute of the University of Michigan and the Shanghai Jiao Tong University in China. His current research interests include deep reinforcement learning, transfer learning, multi-agent systems and meta learning.

Dong Li (Huawei Noah's Ark Lab)
Wulong Liu (Huawei Noah's Ark Lab)
Jianye Hao (Huawei Noah's Ark Lab)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors