arrow
Return

Self-Supervised Temporal Graph Learning With Temporal and Structural Intensity Alignment

delete2024-01-01
delete14
delete
OA
AI
M
Meng Liu
K
Ke Liang
Y
Yawei Zhao
W
Wenxuan Tu
G
Gan, Xinbiao
S
Sihang Zhou
X
Xinwang Liu *
K
Kunlun He *
DOI:10.1109/TNNLS.2024.3386168delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Temporal graph learning aims to generate high-quality representations for graph-based tasks with dynamic information, which has recently garnered increasing attention. In contrast to static graphs, temporal graphs are typically organized as node interaction sequences over continuous time rather than an adjacency matrix. Most temporal graph learning methods model current interactions by incorporating historical neighborhood. However, such methods only consider first-order temporal information while disregarding crucial high-order structural information, resulting in suboptimal performance. To address this issue, we propose a self-supervised method called S2T for temporal graph learning, which extracts both temporal and structural information to learn more informative node representations. Notably, the initial node representations combine first-order temporal and high-order structural information differently to calculate two conditional intensities. An alignment loss is then introduced to optimize the node representations, narrowing the gap between the two intensities and making them more informative. Concretely, in addition to modeling temporal information using historical neighbor sequences, we further consider structural knowledge at both local and global levels. At the local level, we generate structural intensity by aggregating features from high-order neighbor sequences. At the global level, a global representation is generated based on all nodes to adjust the structural intensity according to the active statuses on different nodes. Extensive experiments demonstrate that the proposed model S2T achieves at most 10.13% performance improvement compared with the state-of-the-art competitors on several datasets.
Keywords:
Task analysis
Learning systems
Data mining
Vectors
Feature extraction
Medical diagnostic imaging
Industries
Conditional intensity alignment
self-supervised learning
temporal graph learning

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.5K
Citations:
7.2W

Organization

C
chinese people's liberation army general hospital
Scholars:
1.9W
Papers: 1.1W
Citations: 12
N
national university of defense technology - china
Scholars:
1.8W
Papers: 1.4W
Citations: 9