.png){kind=icon}
返回
Meta-collaboration-based semantic contrast for inductive knowledge representation learning
.png){kind=icon}
PRE
AI
DOI：10.1016/j.eswa.2024.125421.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Inductive knowledge representation learning aims at effectively representing new entities in emerging knowledge graphs based on current ones, providing positive support for reasoning facts with newly emerging entities. It requires a scheme that can derive the instant knowledge to generate rational representations for new entities. Recently, some approaches have been developed for it by capturing logical rules between entities, mining structural information of KGs, or learning multiple structural patterns of entities. However, there are two main challenges that they have yet to overcome. The first is the structural bias-induced semantic ambiguity, , where new entities are typically represented in a manner akin to those with analogous structures, during which the identical structures are emphasized while the differences are overlooked. We refer to this as the structural bias, which will lead to the generated representations of new entities being semantically ambiguous. The second is the potential sparsity of new entities. . The presence of new entities with low frequencies brings about the insufficient representations for these new entities even training a model from scratch with substantial costs. To this end, we propose a Meta-Collaboration-based Semantic Contrast (MCSC) framework with the aim of addressing both issues above. Following the current meta-task formulation scheme, we first acquire the relation-specific knowledge to produce entity representations through modeling relations as feedback. Then, a multi-layer graph neural network module is developed to aggregate sufficient neighbor information to update entity representations. In the final, a collaborative semantic contrast module is designed on both support and query sets to respectively overcome the structural bias-induced semantic ambiguity and the potential sparsity of new entities challenges. Such a meta-collaboration-based semantic contrast procedure transcends current meta-learning paradigms in inductive knowledge representation learning that fail to learn semantically discriminative entity representations. Experimental results of the inductive link prediction task on 12 benchmark datasets demonstrate the superiority of MCSC over SOTA baselines.
Keyword:
Knowledge graph
Inductive knowledge representation learning
Meta-learning
Contrastive leaning
期刊
IF:
7.5
论文数:
2.9W
被引数:
10.2W
机构
引用论文
.png){kind=icon}
Combining prompt learning with contextual semantics for inductive relation prediction将即时学习与上下文语义相结合用于归纳关系预测
PREAI
分享收藏
The “ProQuote” initiative: women journalists in Germany push to revolutionize newsroom leadership
PREAI
分享收藏GOGCN: Graph Convolutional Network on Gene Ontology for Functional Similarity Analysis of Genes
PREAI
分享收藏分享收藏
查看更多内容