arrow
返回

Self-supervised Graph-level Representation Learning with Adversarial Contrastive Learning

delete2023-11-14
delete40
delete
OA
AI
X
Xiao Luo
W
Wei Ju
Y
Yiyang Gu
Z
Zhengyang Mao
L
Luchen Liu
Y
Yuhui Yuan *
M
Ming Zhang *
DOI:10.1145/3624018delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The recently developed unsupervised graph representation learning approaches apply contrastive learning into graph-structured data and achieve promising performance. However, these methods mainly focus on graph augmentation for positive samples, while the negative mining strategies for graph contrastive learning are less explored, leading to sub-optimal performance. To tackle this issue, we propose a Graph Adversarial Contrastive Learning (GraphACL) scheme that learns a bank of negative samples for effective self-supervised whole-graph representation learning. Our GraphACL consists of (i) a graph encoding branch that generates the representations of positive samples and (ii) an adversarial generation branch that produces a bank of negative samples. To generate more powerful hard negative samples, our method minimizes the contrastive loss during encoding updating while maximizing the contrastive loss adversarially over the negative samples for providing the challenging contrastive task. Moreover, the quality of representations produced by the adversarial generation branch is enhanced through the regularization of carefully designed bank divergence loss and bank orthogonality loss. We optimize the parameters of the graph encoding branch and adversarial generation branch alternately. Extensive experiments on 14 real-world benchmarks on both graph classification and transfer learning tasks demonstrate the effectiveness of the proposed approach over existing graph self-supervised representation learning methods.
Keyword:
Graph representation learning
graph neural networks
contrastive learning
self-supervised learning

期刊

ACM Transactions on Knowledge Discovery from Data 封面图
ACM Transactions on Knowledge Discovery from Data
IF:
4.8
论文数:
1.3K
被引数:
4.4K

机构

U
university of california los angeles
学者数:
5.3W
论文数: 4.2W
被引数: 89
P
peking university
学者数:
11.9W
论文数: 8.7W
被引数: 146
University of California System 封面图
University of California System
学者数:
37.7W
论文数: 33.8W
被引数: 6.6K
学者 查看更多机构
引用论文

引用论文

Unsupervised graph-level representation learning with hierarchical contrasts具有层次对比的无监督图级表示学习
err2023-01-01
err41
PREAI
errJu, Wei; Gu, Yiyang; Luo, Xiao; Wang, Yifan; Yuan, Haochen; Zhong, Huasong; Zhang, Ming
err分享
err收藏
GRACE: A General Graph Convolution Framework for Attributed Graph Clustering
err2023-02-22
err12
PREAI
errKamhoua, Barakeel Fanseu; Zhang, Lin; Ma, Kaili; Cheng, James; Li, Bo; Han, Bo
err分享
err收藏
Dual Subgraph-Based Graph Neural Network for Friendship Prediction in Location-Based Social Networks
err2023-02-22
err13
PREAI
errWei, Xuemei; Liu, Yezheng; Sun, Jianshan; Jiang, Yuanchun; Tang, Qifeng; Yuan, Kun
err分享
err收藏
MoleculeNet: a benchmark for molecular machine learning
err2018-01-01
err1.6K
errOAAI
errWu, Zhenqin; Ramsundar, Bharath; Feinberg, Evan N.; Gomes, Joseph; Geniesse, Caleb; Pappu, Aneesh S.; Leswing, Karl; Pande, Vijay
err分享
err收藏
err分享
err收藏
A Review of Microgrids in Latin America: Laboratories and Test Systems
err2022-06-01
err0
PREAI
errJuan M. Rey; Geovanni A. Vera; Pedro Acevedo-Rueda; Javier Solano; Maria A. Mantilla; Jacqueline Llanos; Doris Sáez
err分享
err收藏
err分享
err收藏
学者 查看更多内容