Timezone: »

 
Poster
Simplifying Graph Convolutional Networks
Felix Wu · Amauri Souza · Tianyi Zhang · Christopher Fifty · Tao Yu · Kilian Weinberger

Tue Jun 11 06:30 PM -- 09:00 PM (PDT) @ Pacific Ballroom #267
in Posters Tue »

Graph Convolutional Networks (GCNs) and their variants have experienced significant attention and have become the de facto methods for learning graph representations. GCNs derive inspiration primarily from recent deep learning approaches, and as a result, may inherit unnecessary complexity and redundant computation. In this paper, we reduce this excess complexity through successively removing nonlinearities and collapsing weight matrices between consecutive layers. We theoretically analyze the resulting linear model and show that it corresponds to a fixed low-pass filter followed by a linear classifier. Notably, our experimental evaluation demonstrates that these simplifications do not negatively impact accuracy in many downstream applications. Moreover, the resulting model scales to larger datasets, is naturally interpretable, and yields up to two orders of magnitude speedup over FastGCN.

Keywords: Architectures · Natural Language Processing · Networks and Relational Learning · Semi-supervised learning

Author Information

Felix Wu (Cornell University)
Amauri Souza (Cornell University)
Tianyi Zhang (Cornell University)
Christopher Fifty (Cornell University)
Tao Yu (Shanghai Jiao Tong University)
Kilian Weinberger (Cornell University)

Kilian Weinberger is an Associate Professor in the Department of Computer Science at Cornell University. He received his Ph.D. from the University of Pennsylvania in Machine Learning under the supervision of Lawrence Saul and his undergraduate degree in Mathematics and Computer Science from the University of Oxford. During his career he has won several best paper awards at ICML, CVPR, AISTATS and KDD (runner-up award). In 2011 he was awarded the Outstanding AAAI Senior Program Chair Award and in 2012 he received an NSF CAREER award. He was elected co-Program Chair for ICML 2016 and for AAAI 2018. Kilian Weinberger's research focuses on Machine Learning and its applications. In particular, he focuses on learning under resource constraints, metric learning, machine learned web-search ranking, computer vision and deep learning. Before joining Cornell University, he was an Associate Professor at Washington University in St. Louis and before that he worked as a research scientist at Yahoo! Research in Santa Clara.

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors