arrow
Return

Generative and contrastive graph representation learning with message passing

delete2025-05-01
delete0
PRE
AI
Y
Ying Tang
Y
Yining Yang
G
Guodao Sun *
DOI:10.1016/j.neunet.2025.107224delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Self-supervised graph representation learning (SSGRL) has emerged as a promising approach for graph embeddings because it does not rely on manual labels. SSGRL methods are generally divided into generative and contrastive approaches. Generative methods often suffer from poor graph quality, while contrastive methods, which compare augmented views, are more resistant to noise. However, the performance of contrastive methods depends heavily on well-designed data augmentation and high-quality negative samples. Pure generative or contrastive methods alone cannot balance both robustness and performance. To address these issues, we propose a self-supervised graph representation learning method that integrates generative and contrastive ideas, namely Contrastive Generative Message Passing Graph Learning (CGMP-GL). CGMP-GL incorporates the concept of contrast into the generative model and message aggregation module, enhancing the discriminability of node representations by aligning positive samples and separating negative samples. On one hand, CGMP-GL integrates multi-granularity topology and feature information through cross-view multi-level contrast while reconstructing masked node features. On the other hand, CGMP-GL optimizes node representations through self-supervised contrastive message passing, thereby enhancing model performance in various downstream tasks. Extensive experiments over multiple datasets and downstream tasks demonstrate the effectiveness and robustness of CGMP-GL.
Keywords:
Self-supervised graph representation learning
Graph autoencoder
Contrastive learning
Message passing

Journal

Neural Networks cover
Neural Networks
IF:
6.3
Papers:
8.2K
Citations:
3.0W

Organization

Z
zhejiang university of technology
Scholars:
3.3W
Papers: 2.0W
Citations: 22
Cited Papers

Cited Papers

A prospective study of surgical margin status in oral squamous cell carcinoma: A preliminary report
err2008-12-12
err0
PREAI
errRan Yahalom; Alex Dobriyan; Marilena Vered; Yoav P. Talmi; Shlomo Teicher; Lev Bedrin
errShare
errSave
Defining “Complications” in Spine Surgery
err2010-12-01
err0
PREAI
errBryan Lebude; Sanjay Yadla; Todd Albert; David G. Anderson; James S. Harrop; Alan Hilibrand; Mitchel Maltenfort; Ashwini Sharan; Alexander R. Vaccaro; John K. Ratliff
errShare
errSave
Brillouin Linewidths in CO2Near the Critical Point
err1968-07-01
err0
PREAI
errN. C. Ford; K. H. Langley; V. G. Puglielli
errShare
errSave
Accessibility Disruptions in the Context of Flooding, Fragile Infrastructure and Climate Change
err2022-01-01
err0
PREAI
errManja Hoppe Andreasen; Jytte Agergaard; Lasse Møller-Jensen; Martin Oteng-Ababio; Gerald Yiran
errShare
errSave
errShare
errSave
Self-supervised contrastive graph representation with node and graph augmentation?
err2023-10-01
err8
errOAAI
errDuan, Haoran; Xie, Cheng; Li, Bin; Tang, Peng
errShare
errSave
researcher View more