返回
Explainable reasoning over temporal knowledge graphs by pre-trained language model
DOI:10.1016/j.ipm.2024.103903.png)
摘要
En 中文
Temporal knowledge graph reasoning (TKGR) has been considered as a crucial task for modeling the evolving knowledge, aiming to infer the unknown connections between entities at specific times. Traditional TKGR methods try to aggregate structural information between entities and evolve representations of entities over distinct snapshots, while some other methods attempt to extract temporal logic rules from historical interactions. However, these methods fail to address the continuously emerging unseen entities over time and ignore the historical dependencies between entities and relations. To overcome these limitations, we propose a novel method, termed TPNet, which introduces historical information completion strategy (HICS) and pre-trained language model (PLM) to conduct explainable inductive reasoning over TKGs. Specifically, TPNet extracts reliable temporal logical paths from historical subgraphs using a temporal-correlated search strategy. For unseen entities, we utilize HICS to sample or generate paths to supplement their historical information. Besides, a PLM and a time-aware encoder are introduced to jointly encode the temporal paths, thereby comprehensively capturing dependencies between entities and relations. Moreover, the semantic similarity between the query quadruples and the extracted paths is evaluated to simultaneously optimize the representations of entities and relations. Extensive experiments on entity and relation prediction tasks are conducted to evaluate the performance of TPNet. The experimental results on four benchmark datasets demonstrate the superiority of TPNet over state-of-the-art TKGR methods, achieving improvements of 14.35%, 23.08%, 6.75% and 5.38% on MRR, respectively.
Keyword:
Knowledge graph reasoning
Pre-trained language model
Logical reasoning
Temporal knowledge graph
Multi-hop paths
Graph representation learning
期刊
I
IF:
6.9
论文数:
5.2K
被引数:
1.4W
机构
引用论文
Boosting question answering over knowledge graph with reward integration and policy evaluation under weak supervision在弱监督下通过奖励整合和政策评估提升知识图谱的问题回答
Spatial-temporal traffic performance collaborative forecast in urban road network based on dynamic factor model基于动态因子模型的城市路网交通绩效时空协同预测

