arrow
Return

Multi-view contrastive learning for multilayer network embedding

delete2023-03-01
delete4
PRE
AI
张明杰 (Mingjie Zhang)
D
Dingwen Wang
吴泓润 cover
吴泓润 (Hongrun Wu)
Y
Yuanxiang Li
Z
Zhenglong Xiang *
DOI:10.1016/j.jocs.2023.101975delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Graph embedding aims to learn low-dimension node representations which can be applied to various downstream tasks, such as node clustering and node classification. When it comes to heterogeneous graphs, things get more challenging as the graph contains richer semantic and structural information. Most existing heterogeneous graph embedding methods usually convert the graph into several homogenous graphs, and then use the manual label information to train the model. However, Graph neural networks (GNNs) mostly require task-dependent labels to learn representations, which is even more costly for heterogeneous graphs. Furthermore, these models treat each converted homogenous graph independently while ignoring the inter-layer informative relational clues among the multi-graphs. Inspired by recent advances of Deep Graph Infomax and multi-view learning in homogeneous graph embedding, we propose an unsupervised graph neural network called CLMNE that adopts multi-view contrastive learning and multilayer information fusion for heterogeneous graph embedding. The proposed model learns rich local and global graph information by maximizing the local-global mutual information from adjacency matrix and diffusion matrix two different views. Moreover, a variant model CL-MNEreg, which provides embedding information of all graph layers, is constructed by addingg a consensus regularization to the CL-MNE. Experiments of node clustering and classification tasks on mainstream datasets demonstrate the effectiveness of the proposed two models.
Keywords:
Heterogeneous graphs
Multilayer network embedding
Mutual information maximization
Multi-view contrastive learning

Journal

Nature Computational Science cover
Nature Computational Science
IF:
18.3
Papers:
3.1K
Citations:
4.0K

Organization

W
wuhan university
Scholars:
8.0W
Papers: 5.8W
Citations: 70