arrow
返回

Explainable reasoning over temporal knowledge graphs by pre-trained language model

delete2025-01-01
delete0
PRE
AI
Q
Qing Li
G
Guanzhong Wu *
DOI:10.1016/j.ipm.2024.103903delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Temporal knowledge graph reasoning (TKGR) has been considered as a crucial task for modeling the evolving knowledge, aiming to infer the unknown connections between entities at specific times. Traditional TKGR methods try to aggregate structural information between entities and evolve representations of entities over distinct snapshots, while some other methods attempt to extract temporal logic rules from historical interactions. However, these methods fail to address the continuously emerging unseen entities over time and ignore the historical dependencies between entities and relations. To overcome these limitations, we propose a novel method, termed TPNet, which introduces historical information completion strategy (HICS) and pre-trained language model (PLM) to conduct explainable inductive reasoning over TKGs. Specifically, TPNet extracts reliable temporal logical paths from historical subgraphs using a temporal-correlated search strategy. For unseen entities, we utilize HICS to sample or generate paths to supplement their historical information. Besides, a PLM and a time-aware encoder are introduced to jointly encode the temporal paths, thereby comprehensively capturing dependencies between entities and relations. Moreover, the semantic similarity between the query quadruples and the extracted paths is evaluated to simultaneously optimize the representations of entities and relations. Extensive experiments on entity and relation prediction tasks are conducted to evaluate the performance of TPNet. The experimental results on four benchmark datasets demonstrate the superiority of TPNet over state-of-the-art TKGR methods, achieving improvements of 14.35%, 23.08%, 6.75% and 5.38% on MRR, respectively.
Keyword:
Knowledge graph reasoning
Pre-trained language model
Logical reasoning
Temporal knowledge graph
Multi-hop paths
Graph representation learning

期刊

I
Information Processing and Management
IF:
6.9
论文数:
5.2K
被引数:
1.4W

机构

N
Northwestern Polytechnical University
学者数:
4.6W
论文数: 3.7W
被引数: 5.3W
引用论文

引用论文

Attitudes among health care professionals on the ethics of assisted reproductive technologies and legal abortion
err2001-12-24
err0
PREAI
errISABEL DE LA FUENTE FONNEST; FINN SØNDERGAARD; GERT FONNEST; AGNETE VEDSTED‐JACOBSEN
err分享
err收藏
Efficiently embedding dynamic knowledge graphs
err2022-08-01
err26
errOAAI
errWu, Tianxing; Khan, Arijit; Yong, Melvin; Qi, Guilin; Wang, Meng
err分享
err收藏
A Spatial-Temporal Transformer Network for City-Level Cellular Traffic Analysis and Prediction
err2023-12-01
err11
PREAI
errGu, Bo; Zhan, Junhui; Gong, Shimin; Liu, Wanquan; Su, Zhou; Guizani, Mohsen
err分享
err收藏
学者 查看更多内容