.png){kind=icon}
返回
MEGA: Meta-Graph Augmented Pre-Training Model for Knowledge Graph Completion
.png){kind=icon}
PRE
AI
DOI：10.1145/3617379.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Nowadays, a large number of Knowledge Graph Completion (KGC) methods have been proposed by using embedding based manners, to overcome the incompleteness problem faced with knowledge graph (KG). One important recent innovation in Natural Language Processing (NLP) domain is the employ of deep neural models that make the most of pre-training, culminating in BERT, the most popular example of this line of approaches today. Recently, a series of new KGC methods introducing a pre-trained language model, such as KG-BERT, have been developed and released compelling performance. However, previous pre-training based KGC methods usually train the model by using simple training task and only utilize one-hop relational signals in KG, which leads that they cannot model high-order semantic contexts and multi-hop complex relatedness. To overcome this problem, this article presents a novel pre-training framework for KGC task, which especially consists of both one-hop relation level task (low-order) and multi-hop meta-graph level task (high-order). Hence, the proposed method can capture not only the elaborate sub-graph structure but also the subtle semantic information on the given KG. The empirical results show the efficiency of the proposed method on the widely used real-world datasets.
Keyword:
Knowledge graph completion
meta-graph
pre-training model
multi-task learning
semantic enhancement
期刊
IF:
4.8
论文数:
1.3K
被引数:
4.4K
机构
暂无机构信息
引用论文
.png){kind=icon}
InSight coordinates determination from direct-to-Earth radio-tracking and Mars topography model
PREAI
分享收藏分享收藏
查看更多内容