arrow
Return

TGformer: A Graph Transformer Framework for Knowledge Graph Embedding

delete2025-01-01
delete0
PRE
AI
F
Fobo Shi
D
Duantengchuan Li *
X
Xiaoguang Wang
李
李冰 (Bing Li)
X
Xindong Wu
DOI:10.1109/TKDE.2024.3486747delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Knowledge graph embedding is efficient method for reasoning over known facts and inferring missing links. Existing methods are mainly triplet-based or graph-based. Triplet-based approaches learn the embedding of missing entities by a single triple only. They ignore the fact that the knowledge graph is essentially a graph structure. Graph-based methods consider graph structure information but ignore the contextual information of nodes in the knowledge graph, making them unable to discern valuable entity (relation) information. In response to the above limitations, we propose a general graph transformer framework for knowledge graph embedding (TGformer). It is the first to use a graph transformer to build knowledge embeddings with triplet-level and graph-level structural features in the static and temporal knowledge graph. Specifically, a context-level subgraph is constructed for each predicted triplet, which models the relation between triplets with the same entity. Afterward, we design a knowledge graph transformer network (KGTN) to fully explore multi-structural features in knowledge graphs, including triplet-level and graph-level, boosting the model to understand entities (relations) in different contexts. Finally, semantic matching is adopted to select the entity with the highest score. Experimental results on several public knowledge graph datasets show that our method can achieve state-of-the-art performance in link prediction.
Keywords:
Knowledge graph
graph transformer
link prediction
Knowledge graph
graph transformer
link prediction

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.8K
Citations:
3.2W

Organization

H
hefei university of technology
Scholars:
2.5W
Papers: 1.7W
Citations: 35
W
wuhan university
Scholars:
8.1W
Papers: 5.8W
Citations: 70
Cited Papers

Cited Papers

Electrophysiological correlates of visual backward masking in patients with major depressive disorder
err2019-12-01
err0
errOAAI
errOphélie Favrod; Janir R. da Cruz; Maya Roinishvili; Ekaterine Berdzenishvili; Andreas Brand; Patrícia Figueiredo; Michael H. Herzog; Eka Chkonia
errShare
errSave
Unifying Large Language Models and Knowledge Graphs: A Roadmap
err2024-07-01
err96
PREAI
errPan, Shirui; Luo, Linhao; Wang, Yufei; Chen, Chen; Wang, Jiapu; Wu, Xindong
errShare
errSave
Social-Enhanced Explainable Recommendation With Knowledge Graph
err2024-02-01
err8
PREAI
errLiu, Chunyu; Wu, Wei; Wu, Siyu; Yuan, Lu; Ding, Rui; Zhou, Fuhui; Wu, Qihui
errShare
errSave
Differences in testosterone and its precursors by sex of the offspring in meconium
err2017-03-01
err0
errOAAI
errAlexander J. Frey; Bo Y. Park; Emily R. Schriver; Daniel R. Feldman; Samuel Parry; Lisa A. Croen; Daniele M. Fallin; Irva Hertz-Picciotto; Craig J. Newschaffer; Nathaniel W. Snyder
errShare
errSave
An unusual abnormality of human spermatozoa
err1978-07-01
err0
errOAAI
errE. Aughey; P. S. Orr
errShare
errSave
researcher View more