arrow
Return

Self-supervised Graph-level Representation Learning with Adversarial Contrastive Learning

delete2023-11-14
delete40
delete
OA
AI
X
Xiao Luo
W
Wei Ju
Y
Yiyang Gu
Z
Zhengyang Mao
L
Luchen Liu
Y
Yuhui Yuan *
M
Ming Zhang *
DOI:10.1145/3624018delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The recently developed unsupervised graph representation learning approaches apply contrastive learning into graph-structured data and achieve promising performance. However, these methods mainly focus on graph augmentation for positive samples, while the negative mining strategies for graph contrastive learning are less explored, leading to sub-optimal performance. To tackle this issue, we propose a Graph Adversarial Contrastive Learning (GraphACL) scheme that learns a bank of negative samples for effective self-supervised whole-graph representation learning. Our GraphACL consists of (i) a graph encoding branch that generates the representations of positive samples and (ii) an adversarial generation branch that produces a bank of negative samples. To generate more powerful hard negative samples, our method minimizes the contrastive loss during encoding updating while maximizing the contrastive loss adversarially over the negative samples for providing the challenging contrastive task. Moreover, the quality of representations produced by the adversarial generation branch is enhanced through the regularization of carefully designed bank divergence loss and bank orthogonality loss. We optimize the parameters of the graph encoding branch and adversarial generation branch alternately. Extensive experiments on 14 real-world benchmarks on both graph classification and transfer learning tasks demonstrate the effectiveness of the proposed approach over existing graph self-supervised representation learning methods.
Keywords:
Graph representation learning
graph neural networks
contrastive learning
self-supervised learning

Journal

ACM Transactions on Knowledge Discovery from Data cover
ACM Transactions on Knowledge Discovery from Data
IF:
4.8
Papers:
1.3K
Citations:
4.4K

Organization

U
university of california los angeles
Scholars:
5.3W
Papers: 4.2W
Citations: 89
University of California System cover
University of California System
Scholars:
37.5W
Papers: 33.7W
Citations: 6.6K
P
peking university
Scholars:
11.7W
Papers: 8.7W
Citations: 146
researcher View more organizations