arrow
Return

Knowledge Graph Contrastive Learning Based on Relation-Symmetrical Structure

delete2024-01-01
delete29
delete
OA
AI
K
Ke Liang
刘越 cover
刘越 (Yue Liu)
S
Sihang Zhou
W
Wenxuan Tu
Y
Yi Wen
X
Xihong Yang
X
Xiangjun Dong *
Xinwang Liu cover
Xinwang Liu (Xinwang Liu) *
DOI:10.1109/TKDE.2023.3282989delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Knowledge graph embedding (KGE) aims at learning powerful representations to benefit various artificial intelligence applications. Meanwhile, contrastive learning has been widely leveraged in graph learning as an effective mechanism to enhance the discriminative capacity of the learned representations. However, the complex structures of KG make it hard to construct appropriate contrastive pairs. Only a few attempts have integrated contrastive learning strategies with KGE. But, most of them rely on language models (e.g., Bert) for contrastive pair construction instead of fully mining information underlying the graph structure, hindering expressive ability. Surprisingly, we find that the entities within a relational symmetrical structure are usually similar and correlated. To this end, we propose a knowledge graph contrastive learning framework based on relation-symmetrical structure, KGE-SymCL, which mines symmetrical structure information in KGs to enhance the discriminative ability of KGE models. Concretely, a plug-and-play approach is proposed by taking entities in the relation-symmetrical positions as positive pairs. Besides, a self-supervised alignment loss is designed to pull together positive pairs. Experimental results on link prediction and entity classification datasets demonstrate that our KGE-SymCL can be easily adopted to various KGE models for performance improvements. Moreover, extensive experiments show that our model could outperform other state-of-the-art baselines.
Keywords:
Graph learning
knowledge graph embedding
self-supervised contrastive learning
symmetrical property

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.9K
Citations:
3.2W

Organization

Q
Qilu University of Technology
Scholars:
1.1W
Papers: 8.9K
Citations: 16
N
national university of defense technology - china
Scholars:
1.8W
Papers: 1.4W
Citations: 9
Cited Papers

Cited Papers

Evaluation of suitable reference genes for gene expression studies in porcine alveolar macrophages in response to LPS and LTA
err2012-02-18
err0
errOAAI
errMehmet Ulas Cinar; Mohammad Ariful Islam; Muhammad Jasim Uddin; Ernst Tholen; Dawit Tesfaye; Christian Looft; Karl Schellander
errShare
errSave
Autogenous healing of cement paste
err1957-06-30
err0
errOAAI
errK. R. Lauer; F. O. Slate
errShare
errSave
Deep Learning on Graphs: A Survey
err2022-01-01
err385
errOAAI
errZhang, Ziwei; Cui, Peng; Zhu, Wenwu
errShare
errSave
A Survey on Knowledge Graphs: Representation, Acquisition, and Applications
err2022-02-01
err1.3K
errOAAI
errJi, Shaoxiong; Pan, Shirui; Cambria, Erik; Marttinen, Pekka; Yu, Philip S.
errShare
errSave
OBSTETRIC ULTRASONOGRAPHY
err1997-06-01
err0
PREAI
errMark E. Deutchman; Ricardo Hahn
errShare
errSave
errShare
errSave
Pancreatic cancer risk predicted from disease trajectories using deep learning
err
IF0
err2021-06-28
err0
errOAAI
errDavide Placido; Bo Yuan; Jessica X. Hjaltelin; Chunlei Zheng; Amalie D. Haue; Piotr J Chmura; Chen Yuan; Jihye Kim; Renato Umeton; Gregory Antell; Alexander Chowdhury; Alexandra Franz; Lauren Brais; Elizabeth Andrews; Debora S. Marks; Aviv Regev; Siamack Ayandeh; Mary Brophy; Nhan Do; Peter Kraft; Brian M. Wolpin; Nathanael Fillmore; Michael Rosenthal; Søren Brunak; Chris Sander
errShare
errSave
Adrenal tumors: An experience of 10 years in a single surgical unit
err2015-01-01
err0
PREAI
errS Khanna; R Priya; SK Bhartiya; S Basu; VK Shukla
errShare
errSave
researcher View more