arrow
Return

Graph Self-Supervised Learning: A Survey

delete2022-01-01
delete210
delete
OA
AI
Y
Yixin Liu
M
Ming Jin
Shirui Pan cover
Shirui Pan (Shirui Pan) *
C
Chuan Zhou
Y
Yu Zheng
F
Feng Xia
P
Philip S. Yu
DOI:10.1109/TKDE.2022.3172903delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
Deep learning on graphs has attracted significant interests recently. However, most of the works have focused on (semi-) supervised learning, resulting in shortcomings including heavy label reliance, poor generalization, and weak robustness. To address these issues, self-supervised learning (SSL), which extracts informative knowledge through well-designed pretext tasks without relying on manual labels, has become a promising and trending learning paradigm for graph data. Different from SSL on other domains like computer vision and natural language processing, SSL on graphs has an exclusive background, design ideas, and taxonomies. Under the umbrella of graph self-supervised learning, we present a timely and comprehensive review of the existing approaches which employ SSL techniques for graph data. We construct a unified framework that mathematically formalizes the paradigm of graph SSL. According to the objectives of pretext tasks, we divide these approaches into four categories: generation-based, auxiliary property-based, contrast-based, and hybrid approaches. We further describe the applications of graph SSL across various research fields and summarize the commonly used datasets, evaluation benchmark, performance comparison and open-source codes of graph SSL. Finally, we discuss the remaining challenges and potential future directions in this research field.
Keywords:
Task analysis
Manuals
Supervised learning
Taxonomy
Natural language processing
Data models
Deep learning
Self-supervised learning
graph analytics
deep learning
graph representation learning
graph neural networks

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.9K
Citations:
3.2W

Organization

L
La Trobe University
Scholars:
347
Papers: 156
Citations: 0
University of Illinois System cover
University of Illinois System
Scholars:
6.9W
Papers: 6.2W
Citations: 644
F
Federation University Australia
Scholars:
22
Papers: 18
Citations: 0
M
monash university
Scholars:
1.7K
Papers: 712
Citations: 0
C
Chinese Academy of Sciences
Scholars:
1.5W
Papers: 4.1K
Citations: 0
researcher View more organizations
Cited Papers

Cited Papers

errShare
errSave
errShare
errSave
A Survey on Knowledge Graphs: Representation, Acquisition, and Applications
err2022-02-01
err1.3K
errOAAI
errJi, Shaoxiong; Pan, Shirui; Cambria, Erik; Marttinen, Pekka; Yu, Philip S.
errShare
errSave
Insurance activity and economic performance: Fresh evidence from asymmetric panel causality tests
err2018-10-24
err0
errOAAI
errAbdulnasser Hatemi‐J; Chi‐Chuan Lee; Chien‐Chiang Lee; Rangan Gupta
errShare
errSave
err
IF0
err
err0
errOAAI
err
errShare
errSave
researcher View more