Timezone: »
Graph Neural Networks (GNNs) have achieved remarkable performance on graph-based tasks. The key idea for GNNs is to obtain informative representation through aggregating information from local neighborhoods. However, it remains an open question whether the neighborhood information is adequately aggregated for learning representations of nodes with few neighbors. To address this, we propose a simple and efficient data augmentation strategy, local augmentation, to learn the distribution of the node representations of the neighbors conditioned on the central node's representation and enhance GNN's expressive power with generated features. Local augmentation is a general framework that can be applied to any GNN model in a plug-and-play manner. It samples feature vectors associated with each node from the learned conditional distribution as additional input for the backbone model at each training iteration. Extensive experiments and analyses show that local augmentation consistently yields performance improvement when applied to various GNN architectures across a diverse set of benchmarks. For example, experiments show that plugging in local augmentation to GCN and GAT improves by an average of 3.4\% and 1.6\% in terms of test accuracy on Cora, Citeseer, and Pubmed. Besides, our experimental results on large graphs (OGB) show that our model consistently improves performance over backbones. Code is available at https://github.com/SongtaoLiu0823/LAGNN.
Author Information
Songtao Liu (The Pennsylvania State University)
Rex (Zhitao) Ying (Stanford University)
Hanze Dong (HKUST)
Lanqing Li (Tencent AI Lab)
Tingyang Xu (Tencent Holdings)
Yu Rong (Tencent AI Lab)
Peilin Zhao (Tencent AI Lab)
Junzhou Huang (University of Texas at Arlington / Tencent AI Lab)
Dinghao Wu (Pennsylvania State University)
Related Events (a corresponding poster, oral, or spotlight)
-
2022 Poster: Local Augmentation for Graph Neural Networks »
Wed. Jul 20th through Thu the 21st Room Hall E #225
More from the Same Authors
-
2022 : Enhancing Multi-hop Connectivity for Graph Convolutional Networks »
Songtao Liu · Shixiong Jing · Tong Zhao · Zengfeng Huang · Dinghao Wu -
2023 Poster: FusionRetro: Molecule Representation Fusion via In-Context Learning for Retrosynthetic Planning »
Songtao Liu · Zhengkai Tu · Minkai Xu · Zuobai Zhang · Lu Lin · ZHITAO YING · Jian Tang · Peilin Zhao · Dinghao Wu -
2023 Poster: Weakly Supervised Disentangled Generative Causal Representation Learning »
Xinwei Shen · Furui Liu · Hanze Dong · Qing Lian · Zhitang Chen · Tong Zhang -
2022 : Hypergraph Convolutional Networks via Equivalence Between Hypergraphs and Undirected Graphs »
Jiying Zhang · fuyang li · Xi Xiao · Tingyang Xu · Yu Rong · Junzhou Huang · Yatao Bian -
2022 Poster: Efficient Test-Time Model Adaptation without Forgetting »
Shuaicheng Niu · Jiaxiang Wu · Yifan Zhang · Yaofo Chen · Shijian Zheng · Peilin Zhao · Mingkui Tan -
2022 Spotlight: Efficient Test-Time Model Adaptation without Forgetting »
Shuaicheng Niu · Jiaxiang Wu · Yifan Zhang · Yaofo Chen · Shijian Zheng · Peilin Zhao · Mingkui Tan -
2022 Poster: $p$-Laplacian Based Graph Neural Networks »
Guoji Fu · Peilin Zhao · Yatao Bian -
2022 Spotlight: $p$-Laplacian Based Graph Neural Networks »
Guoji Fu · Peilin Zhao · Yatao Bian -
2022 Poster: Frustratingly Easy Transferability Estimation »
Long-Kai Huang · Junzhou Huang · Yu Rong · Qiang Yang · Ying WEI -
2022 Spotlight: Frustratingly Easy Transferability Estimation »
Long-Kai Huang · Junzhou Huang · Yu Rong · Qiang Yang · Ying WEI -
2021 Poster: Improving Generalization in Meta-learning via Task Augmentation »
Huaxiu Yao · Long-Kai Huang · Linjun Zhang · Ying WEI · Li Tian · James Zou · Junzhou Huang · Zhenhui (Jessie) Li -
2021 Poster: Learning Diverse-Structured Networks for Adversarial Robustness »
Xuefeng Du · Jingfeng Zhang · Bo Han · Tongliang Liu · Yu Rong · Gang Niu · Junzhou Huang · Masashi Sugiyama -
2021 Spotlight: Improving Generalization in Meta-learning via Task Augmentation »
Huaxiu Yao · Long-Kai Huang · Linjun Zhang · Ying WEI · Li Tian · James Zou · Junzhou Huang · Zhenhui (Jessie) Li -
2021 Spotlight: Learning Diverse-Structured Networks for Adversarial Robustness »
Xuefeng Du · Jingfeng Zhang · Bo Han · Tongliang Liu · Yu Rong · Gang Niu · Junzhou Huang · Masashi Sugiyama -
2021 Poster: AdaXpert: Adapting Neural Architecture for Growing Data »
Shuaicheng Niu · Jiaxiang Wu · Guanghui Xu · Yifan Zhang · Yong Guo · Peilin Zhao · Peng Wang · Mingkui Tan -
2021 Spotlight: AdaXpert: Adapting Neural Architecture for Growing Data »
Shuaicheng Niu · Jiaxiang Wu · Guanghui Xu · Yifan Zhang · Yong Guo · Peilin Zhao · Peng Wang · Mingkui Tan -
2021 Poster: Meta-learning Hyperparameter Performance Prediction with Neural Processes »
Ying WEI · Peilin Zhao · Junzhou Huang -
2021 Spotlight: Meta-learning Hyperparameter Performance Prediction with Neural Processes »
Ying WEI · Peilin Zhao · Junzhou Huang -
2020 : Original Research: Frequent Subgraph Mining by Walking in Order Embedding Space »
Rex (Zhitao) Ying -
2020 Workshop: Graph Representation Learning and Beyond (GRL+) »
Petar Veličković · Michael M. Bronstein · Andreea Deac · Will Hamilton · Jessica Hamrick · Milad Hashemi · Stefanie Jegelka · Jure Leskovec · Renjie Liao · Federico Monti · Yizhou Sun · Kevin Swersky · Rex (Zhitao) Ying · Marinka Zitnik -
2020 Poster: Breaking the Curse of Space Explosion: Towards Efficient NAS with Curriculum Search »
Yong Guo · Yaofo Chen · Yin Zheng · Peilin Zhao · Jian Chen · Junzhou Huang · Mingkui Tan -
2020 Poster: Learning to Simulate Complex Physics with Graph Networks »
Alvaro Sanchez-Gonzalez · Jonathan Godwin · Tobias Pfaff · Rex (Zhitao) Ying · Jure Leskovec · Peter Battaglia -
2019 Poster: Hierarchically Structured Meta-learning »
Huaxiu Yao · Ying WEI · Junzhou Huang · Zhenhui (Jessie) Li -
2019 Poster: RaFM: Rank-Aware Factorization Machines »
Xiaoshuang Chen · Yin Zheng · Jiaxing Wang · Wenye Ma · Junzhou Huang -
2019 Oral: Hierarchically Structured Meta-learning »
Huaxiu Yao · Ying WEI · Junzhou Huang · Zhenhui (Jessie) Li -
2019 Oral: RaFM: Rank-Aware Factorization Machines »
Xiaoshuang Chen · Yin Zheng · Jiaxing Wang · Wenye Ma · Junzhou Huang -
2019 Poster: Position-aware Graph Neural Networks »
Jiaxuan You · Rex (Zhitao) Ying · Jure Leskovec -
2019 Oral: Position-aware Graph Neural Networks »
Jiaxuan You · Rex (Zhitao) Ying · Jure Leskovec -
2019 Poster: Collaborative Channel Pruning for Deep Networks »
Hanyu Peng · Jiaxiang Wu · Shifeng Chen · Junzhou Huang -
2019 Oral: Collaborative Channel Pruning for Deep Networks »
Hanyu Peng · Jiaxiang Wu · Shifeng Chen · Junzhou Huang -
2018 Poster: Adversarial Learning with Local Coordinate Coding »
Jiezhang Cao · Yong Guo · Qingyao Wu · Chunhua Shen · Junzhou Huang · Mingkui Tan -
2018 Poster: Error Compensated Quantized SGD and its Applications to Large-scale Distributed Optimization »
Jiaxiang Wu · Weidong Huang · Junzhou Huang · Tong Zhang -
2018 Oral: Adversarial Learning with Local Coordinate Coding »
Jiezhang Cao · Yong Guo · Qingyao Wu · Chunhua Shen · Junzhou Huang · Mingkui Tan -
2018 Oral: Error Compensated Quantized SGD and its Applications to Large-scale Distributed Optimization »
Jiaxiang Wu · Weidong Huang · Junzhou Huang · Tong Zhang -
2018 Poster: Transfer Learning via Learning to Transfer »
Ying WEI · Yu Zhang · Junzhou Huang · Qiang Yang -
2018 Poster: GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Models »
Jiaxuan You · Rex (Zhitao) Ying · Xiang Ren · Will Hamilton · Jure Leskovec -
2018 Oral: GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Models »
Jiaxuan You · Rex (Zhitao) Ying · Xiang Ren · Will Hamilton · Jure Leskovec -
2018 Oral: Transfer Learning via Learning to Transfer »
Ying WEI · Yu Zhang · Junzhou Huang · Qiang Yang