arrow
Return

Self-supervised graph representation learning via bootstrapping

delete2021-10-01
delete14
delete
OA
AI
G
Guohua Yang
张大伟 (Dawei Zhang)
陶建华 (Jianhua Tao) *
T
Tong Liu
DOI:10.1016/j.neucom.2021.03.123delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Graph neural networks (GNNs) apply deep learning techniques to graph-structured data and have achieved promising performance in graph representation learning. However, existing GNNs rely heavily on labeled data or well-designed negative samples. To address these issues, we propose a new self-supervised graph representation method: deep graph bootstrapping (DGB). DGB consists of two neural networks: online and target networks, and the input of them are different augmented views of the initial graph. The online network is trained to predict the target network while the target network is updated with a slow-moving average of the online network, which means the online and target networks can learn from each other. As a result, the proposed DGB can learn graph representation without negative examples in an unsupervised manner. In addition, we summarize three kinds of augmentation methods for graph-structured data and apply them to the DGB. Experiments on the benchmark datasets show the DGB performs better than the current state-of-the-art methods and how the augmentation methods affect the performances. (c) 2021 Elsevier B.V. All rights reserved.
Keywords:
Graph representation learning
Self-supervised
Bootstrapping
Graph neural network
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

C
chinese academy of sciences
Scholars:
56.2W
Papers: 44.8W
Citations: 704