arrow
返回

Self-Supervised Graph Representation Learning via Topology Transformations

delete2023-04-01
delete2
delete
OA
AI
X
Xiang Gao
W
Wei Hu *
G
Guo-Jun Qi
DOI:10.1109/TKDE.2021.3133439delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We present the Topology Transformation Equivariant Representation learning, a general paradigm of self-supervised learning for node representations of graph data to enable the wide applicability of Graph Convolutional Neural Networks (GCNNs). We formalize the proposed model from an information-theoretic perspective, by maximizing the mutual information between topology transformations and node representations before and after the transformations. We derive that maximizing such mutual information can be relaxed to minimizing the cross entropy between the applied topology transformation and its estimation from node representations. In particular, we seek to sample a subset of node pairs from the original graph and flip the edge connectivity between each pair to transform the graph topology. Then, we self-train a representation encoder to learn node representations by reconstructing the topology transformations from the feature representations of the original and transformed graphs. In experiments, we apply the proposed model to the downstream node classification, graph classification and link prediction tasks, and results show that the proposed method outperforms the state-of-the-art unsupervised approaches.
Keyword:
Topology
Representation learning
Network topology
Mutual information
Data models
Task analysis
Transforms
Self-supervised learning
graph representation learning
topology transformation
transformation equivariant representation

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.9K
被引数:
3.2W

机构

P
peking university
学者数:
11.9W
论文数: 8.7W
被引数: 146
引用论文

引用论文

More tricks with tetramers: a practical guide to staining T cells with peptide–MHC multimers
err2015-08-04
err0
errOAAI
errGarry Dolton; Katie Tungatt; Angharad Lloyd; Valentina Bianchi; Sarah M. Theaker; Andrew Trimby; Christopher J. Holland; Marco Donia; Andrew J. Godkin; David K. Cole; Per Thor Straten; Mark Peakman; Inge Marie Svane; Andrew K. Sewell
err分享
err收藏
The US college loans system: Lessons from Australia and England
err2019-08-01
err0
errOAAI
errNicholas Barr; Bruce Chapman; Lorraine Dearden; Susan Dynarski
err分享
err收藏
err分享
err收藏
A vinylidene fluoride block copolymer containing perfluoropolyether groups
err1990-07-01
err0
PREAI
errGiovanni Moggi; Silvana Modena; Giuseppe Marchionni
err分享
err收藏
Retinoblastoma in twins: Risk assessment of genotypic variants
err2021-04-30
err0
errOAAI
errVishal Raval; Meghan DeBenedictis; Randy Bowen; Hansell Soto; Jacquelyn Davanzo; Arun Singh
err分享
err收藏
学者 查看更多内容