arrow
Return

Every node counts: Self-ensembling graph convolutional networks for semi-supervised learning

delete2020-10-01
delete28
delete
OA
AI
罗亚威 (Yawei Luo) *
R
Rongrong Ji
管涛 (Tao Guan)
于俊清 (Junqing Yu)
P
Ping Liu
Y
Yi Yang
DOI:10.1016/j.patcog.2020.107451delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Graph convolutional network (GCN) provides a powerful means for graph-based semi-supervised tasks. However, as a localized first-order approximation of spectral graph convolution, the classic GCN can not take full advantage of unlabeled data, especially when the unlabeled node is far from labeled ones. To capitalize on the information from unlabeled nodes to boost the training for GCN, we propose a novel framework named Self-Ensembling GCN (SEGCN), which marries GCN with Mean Teacher - a powerful self-ensemble learning mechanism for semi-supervised task. SEGCN contains a student model and a teacher model. As a student, it not only learns to correctly classify the labeled nodes, but also tries to be consistent with the teacher on unlabeled nodes in more challenging situations, such as a high dropout rate and graph corrosion. As a teacher, it averages the student model weights and generates more accurate predictions to lead the student. In such a mutual-promoting process, both labeled and unlabeled samples can be fully utilized for backpropagating effective gradients to train GCN. In a variety of semi-supervised classification benchmarks, i.e. Citeseer, Cora, Pubmed and NELL, we validate that the proposed method matches the state of the arts in the classification accuracy. The code is publicly available at https://github.com/RoyalVane/SEGCN. (C) 2020 Elsevier Ltd. All rights reserved.
Keywords:
Teacher-student models
Self-ensemble learning
Graph convolutional networks
Semi-supervised learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

X
xiamen university
Scholars:
5.8W
Papers: 3.8W
Citations: 67