arrow
Return

Multiscale Contrastive Learning for Node Clustering Based on Variational Graph Auto-Encoder

delete2025-10-31
delete0
PRE
AI
N
Nazila Pourhaji Aghayengejeh
M
Mohammad Ali Balafar
J
Jafar Tanha
N
Narjes Nikzad-Khasmakhi
S
Shervin Minaee
DOI:10.1109/TNNLS.2025.3610024delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
Variational graph auto-encoders (VGAEs) are a key tool for node clustering, but existing models face several significant challenges. These challenges include a mismatch between inference and generative models after incorporating the clustering inductive bias, as well as posterior collapse (PC), where latent representations become overly influenced by the prior distribution. In addition, in existing VGAEs, noisy clustering assignments lead to the feature randomness (FR) challenge, while the strong tradeoff between clustering accuracy and reconstruction quality results in the feature drift (FD) problem. To address these issues, we propose a multiscale contrastive VGAE (MCVGAE). This multiscale model combines cluster-level and graph-level contrastive learning with proximity-level and cluster-level self-supervised methods. MCVGAE improves the alignment between the hidden space and the data distribution and prevents PC. Moreover, it reduces FR and FD more effectively than existing techniques. Achieving impressive accuracy scores of 79.09% on Cora, 90.04% on ACM, 75.12% on Pubmed, 72.7% on Citeseer, 74.11% on DBLP, and 59.79% on Wiki clearly demonstrates the superiority of MCVGAE over 30 state-of-the-art methods.
Keywords:
Contrastive learning
node clustering
unsupervised learning
variational graph auto-encoder (VGAE)

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.6K
Citations:
7.2W

Organization

G
gisma university of applied sciences
Scholars:
5
Papers: 6
Citations: 0
A
amazon inc.
Scholars:
4
Papers: 3
Citations: 0
U
university of tabriz
Scholars:
101
Papers: 54
Citations: 0
researcher View more organizations
Cited Papers

Cited Papers

Graph Representation Learning via Graphical Mutual Information Maximization
err2020-04-20
err0
errOAAI
errZhen Peng; Wenbing Huang; Minnan Luo; Qinghua Zheng; Yu Rong; Tingyang Xu; Junzhou Huang
errShare
errSave
Pseudo-Supervised Deep Subspace Clustering
err2021-01-01
err101
errOAAI
errLv, Juncheng; Kang, Zhao; Lu, Xiao; Xu, Zenglin
errShare
errSave
errShare
errSave
Multi-level graph contrastive learning
err2024-02-01
err6
errOAAI
errShao, Pengpeng; Tao, Jianhua
errShare
errSave
Dual-decoder graph autoencoder for unsupervised graph representation learning
err2021-12-01
err25
PREAI
errSun, Dengdi; Li, Dashuang; Ding, Zhuanlian; Zhang, Xingyi; Tang, Jin
errShare
errSave
MGAE
err2017-11-06
err0
PREAI
errChun Wang; Shirui Pan; Guodong Long; Xingquan Zhu; Jing Jiang
errShare
errSave
Improving Variational Graph Autoencoders With Multi-Order Graph Convolutions
err2024-01-01
err2
errOAAI
errYuan, Lining; Jiang, Ping; Wen, Zhu; Li, Jionghui
errShare
errSave
researcher View more