arrow
Return

Learning Augmentation for GNNs With Consistency Regularization

delete2021-01-01
delete2
delete
OA
AI
H
Hyeonjin Park
S
Seunghun Lee
D
Dasol Hwang
J
Jisu Jeong
K
Kyung-Min Kim
J
Jung-Woo Ha
H
Hyunwoo J. Kim *
DOI:10.1109/ACCESS.2021.3111908delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
Graph neural networks (GNNs) have demonstrated superior performance in various tasks on graphs. However, existing GNNs often suffer from weak-generalization due to sparsely labeled datasets. Here we propose a novel framework that learns to augment the input features using topological information and automatically controls the strength of augmentation. Our framework learns the augmentor to minimize GNNs' loss on unseen labeled data while maximizing the consistency of GNNs' predictions on unlabeled data. This can be formulated as a meta-learning problem and our framework alternately optimizes the augmentor and GNNs for a target task. Our extensive experiments demonstrate that the proposed framework is applicable to any GNNs and significantly improves the performance of graph neural networks on node classification. In particular, our method provides 5.78% improvement with Graph convolutional network (GCN) on average across five benchmark datasets.
Keywords:
Task analysis
Graph neural networks
Topology
Training
Data models
Licenses
Training data
Graph neural networks
augmentation
semi-supervised learning
meta-learning

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

N
naver
Scholars:
152
Papers: 129
Citations: 1
K
Korea University
Scholars:
3.6W
Papers: 3.8W
Citations: 4.4W
Cited Papers

Cited Papers

MV-GCN: Multi-View Graph Convolutional Networks for Link Prediction
err2019-01-01
err33
errOAAI
errLi, Zhao; Liu, Zhanlin; Huang, Jiaming; Tang, Geyu; Duan, Yucong; Zhang, Zhiqiang; Yang, Yifan
errShare
errSave
The heritability of insomnia: A meta‐analysis of twin studies
err2020-12-03
err0
errOAAI
errNicola L. Barclay; Desi Kocevska; Wichor M. Bramer; Eus J. W. Van Someren; Philip Gehrman
errShare
errSave
MoleculeNet: a benchmark for molecular machine learning
err2018-01-01
err1.6K
errOAAI
errWu, Zhenqin; Ramsundar, Bharath; Feinberg, Evan N.; Gomes, Joseph; Geniesse, Caleb; Pappu, Aneesh S.; Leswing, Karl; Pande, Vijay
errShare
errSave
An End-to-End Multiplex Graph Neural Network for Graph Representation Learning
err2021-01-01
err3
errOAAI
errLiang, Yanyan; Zhang, Yanfeng; Gao, Dechao; Xu, Qian
errShare
errSave
MRP2Rec: Exploring Multiple-Step Relation Path Semantics for Knowledge Graph-Based Recommendations
err2020-01-01
err10
errOAAI
errWang, Ting; Shi, Daqian; Wang, Zhaodan; Xu, Shuai; Xu, Hao
errShare
errSave
The role of natural killer T cells in a mouse model with spontaneous bile duct inflammation
err2017-02-20
err0
errOAAI
errElisabeth Schrumpf; Xiaojun Jiang; Sebastian Zeissig; Marion J. Pollheimer; Jarl Andreas Anmarkrud; Corey Tan; Mark A. Exley; Tom H. Karlsen; Richard S. Blumberg; Espen Melum
errShare
errSave
Signals, Sound, and Sensation
err2008-01-11
err0
PREAI
errWilliam M. Hartmann; Stephen T. Neely
errShare
errSave
researcher View more