Timezone: »
This paper studies few-shot relation extraction, which aims at predicting the relation for a pair of entities in a sentence by training with a few labeled examples in each relation. To more effectively generalize to new relations, in this paper we study the relationships between different relations and propose to leverage a global relation graph. We propose a novel Bayesian meta-learning approach to effectively learn the posterior distribution of the prototype vectors of relations, where the initial prior of the prototype vectors is parameterized with a graph neural network on the global relation graph. Moreover, to effectively optimize the posterior distribution of the prototype vectors, we propose to use the stochastic gradient Langevin dynamics, which is related to the MAML algorithm but is able to handle the uncertainty of the prototype vectors. The whole framework can be effectively and efficiently optimized in an end-to-end fashion. Experiments on two benchmark datasets prove the effectiveness of our proposed approach against competitive baselines in both the few-shot and zero-shot settings.
Author Information
Meng Qu (Mila)
Tianyu Gao (Tsinghua University)
Louis-Pascal Xhonneux (Mila / Université de Montréal)
Jian Tang (HEC Montreal & MILA)
More from the Same Authors
-
2023 : A*Net: A Scalable Path-based Reasoning Approach for Knowledge Graphs »
Zhaocheng Zhu · Xinyu Yuan · Mikhail Galkin · Louis-Pascal Xhonneux · Ming Zhang · Maxime Gazeau · Jian Tang -
2022 Poster: Neural-Symbolic Models for Logical Queries on Knowledge Graphs »
Zhaocheng Zhu · Mikhail Galkin · Zuobai Zhang · Jian Tang -
2022 Spotlight: Neural-Symbolic Models for Logical Queries on Knowledge Graphs »
Zhaocheng Zhu · Mikhail Galkin · Zuobai Zhang · Jian Tang -
2021 Poster: Self-supervised Graph-level Representation Learning with Local and Global Structure »
Minghao Xu · Hang Wang · Bingbing Ni · Hongyu Guo · Jian Tang -
2021 Spotlight: Self-supervised Graph-level Representation Learning with Local and Global Structure »
Minghao Xu · Hang Wang · Bingbing Ni · Hongyu Guo · Jian Tang -
2021 Poster: Learning Gradient Fields for Molecular Conformation Generation »
Chence Shi · Shitong Luo · Minkai Xu · Jian Tang -
2021 Poster: An End-to-End Framework for Molecular Conformation Generation via Bilevel Programming »
Minkai Xu · Wujie Wang · Shitong Luo · Chence Shi · Yoshua Bengio · Rafael Gomez-Bombarelli · Jian Tang -
2021 Poster: Non-Autoregressive Electron Redistribution Modeling for Reaction Prediction »
Hangrui Bi · Hengyi Wang · Chence Shi · Connor Coley · Jian Tang · Hongyu Guo -
2021 Spotlight: Non-Autoregressive Electron Redistribution Modeling for Reaction Prediction »
Hangrui Bi · Hengyi Wang · Chence Shi · Connor Coley · Jian Tang · Hongyu Guo -
2021 Spotlight: An End-to-End Framework for Molecular Conformation Generation via Bilevel Programming »
Minkai Xu · Wujie Wang · Shitong Luo · Chence Shi · Yoshua Bengio · Rafael Gomez-Bombarelli · Jian Tang -
2021 Oral: Learning Gradient Fields for Molecular Conformation Generation »
Chence Shi · Shitong Luo · Minkai Xu · Jian Tang -
2020 Workshop: Bridge Between Perception and Reasoning: Graph Neural Networks & Beyond »
Jian Tang · Le Song · Jure Leskovec · Renjie Liao · Yujia Li · Sanja Fidler · Richard Zemel · Ruslan Salakhutdinov -
2020 : Opening Remarks: Jian Tang & Le Song »
Jian Tang · Le Song -
2020 Poster: A Graph to Graphs Framework for Retrosynthesis Prediction »
Chence Shi · Minkai Xu · Hongyu Guo · Ming Zhang · Jian Tang -
2020 Poster: Learning to Navigate The Synthetically Accessible Chemical Space Using Reinforcement Learning »
Sai Krishna Gottipati · Boris Sattarov · Sufeng Niu · Yashaswi Pathak · Haoran Wei · Shengchao Liu · Shengchao Liu · Simon Blackburn · Karam Thomas · Connor Coley · Jian Tang · Sarath Chandar · Yoshua Bengio -
2020 Poster: Continuous Graph Neural Networks »
Louis-Pascal Xhonneux · Meng Qu · Jian Tang -
2019 Poster: GMNN: Graph Markov Neural Networks »
Meng Qu · Yoshua Bengio · Jian Tang -
2019 Oral: GMNN: Graph Markov Neural Networks »
Meng Qu · Yoshua Bengio · Jian Tang