arrow
返回

TracKGE: Transformer with Relation-pattern Adaptive Contrastive Learning for Knowledge Graph Embedding

delete2024-10-01
delete0
PRE
AI
Z
Zijie Li
J
Jun Wang
W
Wei Zou
J
Juxiang Zhou
J
Jianhou Gan *
DOI:10.1016/j.knosys.2024.112218delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Knowledge Graphs, fundamental to intelligent applications, are increasingly critical in various domains, enhancing tasks like precise searching and personalized recommendation. Effectively representing entities and relationships in these graphs is key, especially as the Transformer model, despite its representational prowess, faces challenges in adapting to the graph's structure and complex relations. In this work, we present the Transformer with Relation-pattern Adaptive Contrastive Learning for Knowledge Graph Embedding (TracKGE). Specifically, TracKGE transforms the structural information of the knowledge graph into a sequence format that is more manageable for Transformers. In addition, we employ a relation-pattern adaptive contrastive learning module to capture a richer semantic and complex relationship pattern information of the knowledge graph. Lastly, by introducing a mask node model, it addresses the issue of incomplete information in the knowledge graph, further enhancing the model's capability to capture implicit relationships within it. To evaluate the performance of our model, we have chosen well-established models as baselines and executed link prediction tasks on four renowned datasets. Our experimental results reveal that our model excels in representing the semantics and intricate structures of Knowledge Graphs. It outperforms other advanced baseline models, showcasing its superior capability in handling complex data representations.
Keyword:
Knowledge graph embedding
Transformer
Contrastive learning
Link prediction

期刊

K
Knowledge-Based Systems
IF:
7.6
论文数:
1.2W
被引数:
4.5W

机构

Y
yunnan normal university
学者数:
4.8K
论文数: 2.7K
被引数: 9
引用论文

引用论文

err分享
err收藏
BERT and hierarchical cross attention-based question answering over bridge inspection knowledge graph
err2023-12-01
err9
PREAI
errYang, Jianxi; Yang, Xiaoxia; Li, Ren; Luo, Mengting; Jiang, Shixin; Zhang, Yue; Wang, Di
err分享
err收藏
Knowledge Graphs: Opportunities and Challenges知识图谱: 机遇与挑战
err2023-04-03
err99
errOAAI
errPeng, Ciyuan; Xia, Feng; Naseriparsa, Mehdi; Osborne, Francesco
err分享
err收藏
学者 查看更多内容