arrow
Return

Self-supervised Graph-level Representation Learning with Adversarial Contrastive Learning

delete2023-11-14
delete40
delete
OA
AI
X
Xiao Luo
W
Wei Ju
Y
Yiyang Gu
Z
Zhengyang Mao
L
Luchen Liu
Y
Yuhui Yuan *
M
Ming Zhang *
DOI:10.1145/3624018delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The recently developed unsupervised graph representation learning approaches apply contrastive learning into graph-structured data and achieve promising performance. However, these methods mainly focus on graph augmentation for positive samples, while the negative mining strategies for graph contrastive learning are less explored, leading to sub-optimal performance. To tackle this issue, we propose a Graph Adversarial Contrastive Learning (GraphACL) scheme that learns a bank of negative samples for effective self-supervised whole-graph representation learning. Our GraphACL consists of (i) a graph encoding branch that generates the representations of positive samples and (ii) an adversarial generation branch that produces a bank of negative samples. To generate more powerful hard negative samples, our method minimizes the contrastive loss during encoding updating while maximizing the contrastive loss adversarially over the negative samples for providing the challenging contrastive task. Moreover, the quality of representations produced by the adversarial generation branch is enhanced through the regularization of carefully designed bank divergence loss and bank orthogonality loss. We optimize the parameters of the graph encoding branch and adversarial generation branch alternately. Extensive experiments on 14 real-world benchmarks on both graph classification and transfer learning tasks demonstrate the effectiveness of the proposed approach over existing graph self-supervised representation learning methods.
Keywords:
Graph representation learning
graph neural networks
contrastive learning
self-supervised learning

Journal

ACM Transactions on Knowledge Discovery from Data cover
ACM Transactions on Knowledge Discovery from Data
IF:
4.8
Papers:
1.3K
Citations:
4.4K

Organization

U
university of california los angeles
Scholars:
5.3W
Papers: 4.2W
Citations: 89
P
peking university
Scholars:
11.9W
Papers: 8.7W
Citations: 146
University of California System cover
University of California System
Scholars:
37.7W
Papers: 33.8W
Citations: 6.6K
researcher View more organizations
Cited Papers

Cited Papers

Unsupervised graph-level representation learning with hierarchical contrasts
err2023-01-01
err41
PREAI
errJu, Wei; Gu, Yiyang; Luo, Xiao; Wang, Yifan; Yuan, Haochen; Zhong, Huasong; Zhang, Ming
errShare
errSave
GRACE: A General Graph Convolution Framework for Attributed Graph Clustering
err2023-02-22
err12
PREAI
errKamhoua, Barakeel Fanseu; Zhang, Lin; Ma, Kaili; Cheng, James; Li, Bo; Han, Bo
errShare
errSave
Dual Subgraph-Based Graph Neural Network for Friendship Prediction in Location-Based Social Networks
err2023-02-22
err13
PREAI
errWei, Xuemei; Liu, Yezheng; Sun, Jianshan; Jiang, Yuanchun; Tang, Qifeng; Yuan, Kun
errShare
errSave
MoleculeNet: a benchmark for molecular machine learning
err2018-01-01
err1.6K
errOAAI
errWu, Zhenqin; Ramsundar, Bharath; Feinberg, Evan N.; Gomes, Joseph; Geniesse, Caleb; Pappu, Aneesh S.; Leswing, Karl; Pande, Vijay
errShare
errSave
errShare
errSave
A Review of Microgrids in Latin America: Laboratories and Test Systems
err2022-06-01
err0
PREAI
errJuan M. Rey; Geovanni A. Vera; Pedro Acevedo-Rueda; Javier Solano; Maria A. Mantilla; Jacqueline Llanos; Doris Sáez
errShare
errSave
Dynamic Graph Convolutional Recurrent Network for Traffic Prediction: Benchmark and Solution
err2023-02-20
err208
errOAAI
errLi, Fuxian; Feng, Jie; Yan, Huan; Jin, Guangyin; Yang, Fan; Sun, Funing; Jin, Depeng; Li, Yong
errShare
errSave
errShare
errSave
researcher View more