Timezone: »
The formation of a real-world graph typically arises from the highly complex interaction of many latent factors.
The existing deep learning methods for graph-structured data neglect the entanglement of the latent factors, rendering the learned representations non-robust and hardly explainable.
However, learning representations that disentangle the latent factors poses great challenges and remains largely unexplored in the literature of graph neural networks.
In this paper, we introduce the disentangled graph convolutional network (DisenGCN) to learn disentangled node representations.
In particular, we propose a novel neighborhood routing mechanism, which is capable of dynamically identifying the latent factor that may have caused the edge between a node and one of its neighbors, and accordingly assigning the neighbor to a channel that extracts and convolutes features specific to that factor.
We theoretically prove the convergence properties of the routing mechanism.
Empirical results show that our proposed model can achieve significant performance gains, especially when the data demonstrate the existence of many entangled factors.
Author Information
Jianxin Ma (Tsinghua University)
Peng Cui (Tsinghua University)
Peng Cui is an Associate Professor in Tsinghua University. He got his PhD degree from Tsinghua University in 2010. His research interests include causal inference and stable learning, network representation learning, and human behavioral modeling. He has published more than 100 papers in prestigious conferences and journals in data mining and multimedia. His recent research won the IEEE Multimedia Best Department Paper Award, SIGKDD 2016 Best Paper Finalist, ICDM 2015 Best Student Paper Award, SIGKDD 2014 Best Paper Finalist, IEEE ICME 2014 Best Paper Award, ACM MM12 Grand Challenge Multimodal Award, and MMM13 Best Paper Award. He is the Associate Editors of IEEE TKDE, IEEE TBD, ACM TIST, and ACM TOMM etc. He has served as program co-chair and area chair of several major machine learning and artificial intelligence conferences, such as IJCAI, AAAI, ACM CIKM, ACM Multimedia etc.
Kun Kuang (Tsinghua University)
Xin Wang (Tsinghua University)
Wenwu Zhu (Tsinghua University)
Wenwu Zhu is currently a Professor of Computer Science Department of Tsinghua University and Vice Dean of National Research Center on Information Science and Technology. Prior to his current post, he was a Senior Researcher and Research Manager at Microsoft Research Asia. He was the Chief Scientist and Director at Intel Research China from 2004 to 2008. He worked at Bell Labs New Jersey as a Member of Technical Staff during 1996-1999. He has been serving as the chair of the steering committee for IEEE T-MM since January 1, 2020. He served as the Editor-in-Chief for the IEEE Transactions on Multimedia (T-MM) from 2017 to 2019. And Vice EiC for IEEE Transactions on Circuits and Systems for Video Technology (TCSVT) from 2020-2021 He served as co-Chair for ACM MM 2018 and co-Chair for ACM CIKM 2019. His current research interests are in the areas of multimodal big data and intelligence, and multimedia networking. He received 10 Best Paper Awards. He is a member of Academia Europaea, an IEEE Fellow, AAAS Fellow, and SPIE Fellow.
Related Events (a corresponding poster, oral, or spotlight)
-
2019 Poster: Disentangled Graph Convolutional Networks »
Thu. Jun 13th 01:30 -- 04:00 AM Room Pacific Ballroom #175
More from the Same Authors
-
2023 Poster: Competing for Shareable Arms in Multi-Player Multi-Armed Bandits »
Renzhe Xu · Haotian Wang · Xingxuan Zhang · Bo Li · Peng Cui -
2023 Poster: Curriculum Co-disentangled Representation Learning across Multiple Environments for Social Recommendation »
Xin Wang · Zirui Pan · Yuwei Zhou · Hong Chen · Chendi Ge · Wenwu Zhu -
2023 Poster: Propensity Matters: Measuring and Enhancing Balancing for Recommendation »
Haoxuan Li · Yanghao Xiao · Chunyuan Zheng · Peng Wu · Peng Cui -
2023 Poster: Provably Invariant Learning without Domain Information »
Xiaoyu Tan · Yong LIN · Shengyu Zhu · Chao Qu · Xihe Qiu · Xu Yinghui · Peng Cui · Yuan Qi -
2023 Poster: Wasserstein Barycenter Matching for Graph Size Generalization of Message Passing Neural Networks »
Xu Chu · Yujie Jin · Xin Wang · Shanghang Zhang · Yasha Wang · Wenwu Zhu · Hong Mei -
2022 Poster: Counterfactual Prediction for Outcome-Oriented Treatments »
Hao Zou · Bo Li · Jiangang Han · Shuiping Chen · Xuetao Ding · Peng Cui -
2022 Poster: Graph Neural Architecture Search Under Distribution Shifts »
Yijian Qin · Xin Wang · Ziwei Zhang · Pengtao Xie · Wenwu Zhu -
2022 Spotlight: Counterfactual Prediction for Outcome-Oriented Treatments »
Hao Zou · Bo Li · Jiangang Han · Shuiping Chen · Xuetao Ding · Peng Cui -
2022 Spotlight: Graph Neural Architecture Search Under Distribution Shifts »
Yijian Qin · Xin Wang · Ziwei Zhang · Pengtao Xie · Wenwu Zhu -
2022 Poster: Auxiliary Learning with Joint Task and Data Scheduling »
Hong Chen · Xin Wang · Chaoyu Guan · Yue Liu · Wenwu Zhu -
2022 Spotlight: Auxiliary Learning with Joint Task and Data Scheduling »
Hong Chen · Xin Wang · Chaoyu Guan · Yue Liu · Wenwu Zhu -
2022 Poster: DNA: Domain Generalization with Diversified Neural Averaging »
Xu Chu · Yujie Jin · Wenwu Zhu · Yasha Wang · Xin Wang · Shanghang Zhang · Hong Mei -
2022 Poster: A Theoretical Analysis on Independence-driven Importance Weighting for Covariate-shift Generalization »
Renzhe Xu · Xingxuan Zhang · Zheyan Shen · Tong Zhang · Peng Cui -
2022 Poster: Parametric Visual Program Induction with Function Modularization »
Xuguang Duan · Xin Wang · Ziwei Zhang · Wenwu Zhu -
2022 Poster: Model Agnostic Sample Reweighting for Out-of-Distribution Learning »
Xiao Zhou · Yong LIN · Renjie Pi · Weizhong Zhang · Renzhe Xu · Peng Cui · Tong Zhang -
2022 Poster: Large-Scale Graph Neural Architecture Search »
Chaoyu Guan · Xin Wang · Hong Chen · Ziwei Zhang · Wenwu Zhu -
2022 Spotlight: A Theoretical Analysis on Independence-driven Importance Weighting for Covariate-shift Generalization »
Renzhe Xu · Xingxuan Zhang · Zheyan Shen · Tong Zhang · Peng Cui -
2022 Spotlight: Large-Scale Graph Neural Architecture Search »
Chaoyu Guan · Xin Wang · Hong Chen · Ziwei Zhang · Wenwu Zhu -
2022 Spotlight: Parametric Visual Program Induction with Function Modularization »
Xuguang Duan · Xin Wang · Ziwei Zhang · Wenwu Zhu -
2022 Spotlight: Model Agnostic Sample Reweighting for Out-of-Distribution Learning »
Xiao Zhou · Yong LIN · Renjie Pi · Weizhong Zhang · Renzhe Xu · Peng Cui · Tong Zhang -
2022 Spotlight: DNA: Domain Generalization with Diversified Neural Averaging »
Xu Chu · Yujie Jin · Wenwu Zhu · Yasha Wang · Xin Wang · Shanghang Zhang · Hong Mei -
2021 Workshop: ICML Workshop on Human in the Loop Learning (HILL) »
Trevor Darrell · Xin Wang · Li Erran Li · Fisher Yu · Zeynep Akata · Wenwu Zhu · Pradeep Ravikumar · Shiji Zhou · Shanghang Zhang · Kalesha Bullard -
2021 Poster: Heterogeneous Risk Minimization »
Jiashuo Liu · Zheyuan Hu · Peng Cui · Bo Li · Zheyan Shen -
2021 Spotlight: Heterogeneous Risk Minimization »
Jiashuo Liu · Zheyuan Hu · Peng Cui · Bo Li · Zheyan Shen -
2021 Poster: AutoAttend: Automated Attention Representation Search »
Chaoyu Guan · Xin Wang · Wenwu Zhu -
2021 Spotlight: AutoAttend: Automated Attention Representation Search »
Chaoyu Guan · Xin Wang · Wenwu Zhu -
2021 Poster: Explainable Automated Graph Representation Learning with Hyperparameter Importance »
Xin Wang · Shuyi Fan · Kun Kuang · Wenwu Zhu -
2021 Spotlight: Explainable Automated Graph Representation Learning with Hyperparameter Importance »
Xin Wang · Shuyi Fan · Kun Kuang · Wenwu Zhu -
2020 : Invited Talk 10: Prof. Wenwu Zhu from Tsinghua University »
Wenwu Zhu -
2019 : Poster Session 1 (all papers) »
Matilde Gargiani · Yochai Zur · Chaim Baskin · Evgenii Zheltonozhskii · Liam Li · Ameet Talwalkar · Xuedong Shang · Harkirat Singh Behl · Atilim Gunes Baydin · Ivo Couckuyt · Tom Dhaene · Chieh Lin · Wei Wei · Min Sun · Orchid Majumder · Michele Donini · Yoshihiko Ozaki · Ryan P. Adams · Christian Geißler · Ping Luo · zhanglin peng · · Ruimao Zhang · John Langford · Rich Caruana · Debadeepta Dey · Charles Weill · Xavi Gonzalvo · Scott Yang · Scott Yak · Eugen Hotaj · Vladimir Macko · Mehryar Mohri · Corinna Cortes · Stefan Webb · Jonathan Chen · Martin Jankowiak · Noah Goodman · Aaron Klein · Frank Hutter · Mojan Javaheripi · Mohammad Samragh · Sungbin Lim · Taesup Kim · SUNGWOONG KIM · Michael Volpp · Iddo Drori · Yamuna Krishnamurthy · Kyunghyun Cho · Stanislaw Jastrzebski · Quentin de Laroussilhe · Mingxing Tan · Xiao Ma · Neil Houlsby · Andrea Gesmundo · Zalán Borsos · Krzysztof Maziarz · Felipe Petroski Such · Joel Lehman · Kenneth Stanley · Jeff Clune · Pieter Gijsbers · Joaquin Vanschoren · Felix Mohr · Eyke Hüllermeier · Zheng Xiong · Wenpeng Zhang · Wenwu Zhu · Weijia Shao · Aleksandra Faust · Michal Valko · Michael Y Li · Hugo Jair Escalante · Marcel Wever · Andrey Khorlin · Tara Javidi · Anthony Francis · Saurajit Mukherjee · Jungtaek Kim · Michael McCourt · Saehoon Kim · Tackgeun You · Seungjin Choi · Nicolas Knudde · Alexander Tornede · Ghassen Jerfel -
2019 Tutorial: Causal Inference and Stable Learning »
Tong Zhang · Peng Cui -
2017 Poster: Projection-free Distributed Online Learning in Networks »
Wenpeng Zhang · Peilin Zhao · Wenwu Zhu · Steven Hoi · Tong Zhang -
2017 Talk: Projection-free Distributed Online Learning in Networks »
Wenpeng Zhang · Peilin Zhao · Wenwu Zhu · Steven Hoi · Tong Zhang