arrow
返回

Graph Contrastive Learning With Adaptive Proximity-Based Graph Augmentation

delete2024-10-01
delete3
PRE
AI
W
Wei Zhuo
G
Guang Tan *
DOI:10.1109/TNNLS.2023.3278183delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Graph neural networks (GNNs) have been successful in a variety of graph-based applications. Recently, it is shown that capturing long-range relationships between nodes helps improve the performance of GNNs. The phenomenon is mostly confirmed in a supervised learning setting. In this article, inspired by contrastive learning (CL), we propose an unsupervised learning pipeline, in which different types of long-range similarity information are injected into the GNN model in an efficient way. We reconstruct the original graph in feature and topology spaces to generate three augmented views. During training, our model alternately picks an augmented view, and maximizes an agreement between the representations of the view and the original graph. Importantly, we identify the issue of diminishing utility of the augmented views as the model gradually learns useful information from the views. Hence, we propose a view update scheme that adaptively adjusts the augmented views, so that the views can continue to provide new information that helps with CL. The updated augmented views and the original graph are jointly used to train a shared GNN encoder by optimizing an efficient channel-level contrastive objective. We conduct extensive experiments on six assortative graphs and three disassortative graphs, which demonstrate the effectiveness of our method.
Keyword:
Topology
Training
Graph neural networks
Adaptation models
Task analysis
Representation learning
Network topology
Contrastive learning (CL)
data augmentation
graph neural network (GNN)
representation learning

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

S
Sun Yat Sen University
学者数:
9.9W
论文数: 7.2W
被引数: 95
引用论文

引用论文

Insurance activity and economic performance: Fresh evidence from asymmetric panel causality tests
err2018-10-24
err0
errOAAI
errAbdulnasser Hatemi‐J; Chi‐Chuan Lee; Chien‐Chiang Lee; Rangan Gupta
err分享
err收藏
err
IF0
err
err0
errOAAI
err
err分享
err收藏
Anomaly Detection on Attributed Networks via Contrastive Self-Supervised Learning
err2022-06-01
err197
errOAAI
errLiu, Yixin; Li, Zhao; Pan, Shirui; Gong, Chen; Zhou, Chuan; Karypis, George
err分享
err收藏
Interpretation of aeromagnetic data in the Franklin area, northern New Zealand
err2017-01-09
err0
PREAI
errD. J. Robertson; P. N. P. Vidanovich; S. K. Zoellner; J. B. Meyers
err分享
err收藏
The heritability of insomnia: A meta‐analysis of twin studies
err2020-12-03
err0
errOAAI
errNicola L. Barclay; Desi Kocevska; Wichor M. Bramer; Eus J. W. Van Someren; Philip Gehrman
err分享
err收藏
Southeast Asian diversity: first insights into the complex mtDNA structure of Laos
err2011-02-18
err0
errOAAI
errMartin Bodner; Bettina Zimmermann; Alexander Röck; Anita Kloss-Brandstätter; David Horst; Basil Horst; Sourideth Sengchanh; Torpong Sanguansermsri; Jürgen Horst; Tanja Krämer; Peter M Schneider; Walther Parson
err分享
err收藏
Asymmetric dynamics of insurance premium: the impacts of output and economic policy uncertainty
err2018-08-01
err0
errOAAI
errRangan Gupta; Amine Lahiani; Chi-Chuan Lee; Chien-Chiang Lee
err分享
err收藏
学者 查看更多内容