arrow
Return

UniTrain: A universal iterative semi-supervised training framework for graph representation learning

delete2026-01-19
delete0
PRE
AI
X
Xinlong Chen
J
Jin Li
Y
Yisong Huang
J
Jianzhi Zhuang
C
Chenjunhao Shi
Z
Zuhao Xu
傅仰耿 cover
傅仰耿 (Yang-Geng Fu)
DOI:10.1016/j.neunet.2026.108623delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Graph neural networks (GNNs) and graph transformers (GTs) perform well in graph-related tasks, but their potential is often limited in semi-supervised settings due to label scarcity. Although robust encoders and pre-training tasks enhance performance, GNNs or GTs remain prone to over-fitting and task gaps. To address these issues, we propose the Universal iterative semi-supervised Training framework (UniTrain), which generates high-quality pseudo-labels for unlabeled nodes in a multi-stage manner. Within UniTrain, a semantic graph is constructed using hidden vector representations from pre-training stage. Label knowledge propagation with uncertainty filtering is then applied to infer or refine labels for unlabeled nodes. By incorporating high-confidence pseudo-labels, the framework mitigates noise and compensates for the limited guidance of original labels. UniTrain enhances fine-tuning in existing self-supervised methods and is compatible with any GNN or GT encoder. Extensive experiments conduct on seven graph-based benchmarks (Cora, Citeseer, Pubmed, Actor, Cornell, Texas, and Wisconsin) demonstrate significant improvements in node classification performance when applying UniTrain to both GNNs and GTs. These results validate the effectiveness and generalization capability of our method.

Journal

Neural Networks cover
Neural Networks
IF:
6.3
Papers:
8.2K
Citations:
3.0W

Organization

F
fuzhou university
Scholars:
3.3W
Papers: 2.1W
Citations: 31
Cited Papers

Cited Papers

errShare
errSave
Nonlinear Component Analysis as a Kernel Eigenvalue Problem
err1998-07-01
err0
errOAAI
errBernhard Schölkopf; Alexander Smola; Klaus-Robert Müller
errShare
errSave
Collective Classification in Network Data
err2008-09-01
err0
errOAAI
errPrithviraj Sen; Galileo Namata; Mustafa Bilgic; Lise Getoor; Brian Gallagher; Tina Eliassi‐Rad
errShare
errSave
Semi-supervised learning with pseudo-negative labels for image classification
err2023-01-01
err17
errOAAI
errXu, Hao; Xiao, Hui; Hao, Huazheng; Dong, Li; Qiu, Xiaojie; Peng, Chengbin
errShare
errSave
errShare
errSave
A comprehensive survey on contrastive learning
err2024-12-01
err6
PREAI
errHu, Haigen; Wang, Xiaoyuan; Zhang, Yan; Chen, Qi; Guan, Qiu
errShare
errSave
researcher View more