arrow
返回

ADRL: An attention-based deep reinforcement learning framework for knowledge graph reasoning

delete2020-06-01
delete44
PRE
AI
Q
Qi Wang *
郝
郝永生 (Yongsheng Hao)
J
Jie Cao
DOI:10.1016/j.knosys.2020.105910delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Knowledge graph reasoning is one of the key technologies for knowledge graph construction, which plays an important part in application scenarios such as vertical search and intelligent question answering. It is intended to infer the desired entity from the entities and relations that already exist in the knowledge graph. Most current methods for reasoning, such as embedding-based methods, globally embed all entities and relations, and then use the similarity of vectors to infer relations between entities or whether given triples are true. However, in real application scenarios, we require a clear and interpretable target entity as the output answer. In this paper, we propose a novel attention-based deep reinforcement learning framework (ADRL) for learning multi-hop relational paths, which improves the efficiency, generalization capacity, and interpretability of conventional approaches through the structured perception of deep learning and relational reasoning of reinforcement learning. We define the entire process of reasoning as a Markov decision process. First, we employ CNN to map the knowledge graph to a low-dimensional space, and a message-passing mechanism to sense neighbor entities at each level, and then employ LSTM to memorize and generate a sequence of historical trajectories to form a policy and value functions. We design a relational module that includes a self-attention mechanism that can infer and share the weights of neighborhood entity vectors and relation vectors. Finally, we employ the actor-critic algorithm to optimize the entire framework. Experiments confirm the effectiveness and efficiency of our method on several benchmark data sets. (C) 2020 Elsevier B.V. All rights reserved.
Keyword:
Knowledge graph
Knowledge reasoning
Reinforcement learning
Deep learning
Attention
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

K
Knowledge-Based Systems
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

F
fudan university
学者数:
11.8W
论文数: 7.7W
被引数: 121
X
Xuzhou University of Technology
学者数:
1.7K
论文数: 1.3K
被引数: 2.6K
引用论文

引用论文

err分享
err收藏
Relational reinforcement learning
err2001-01-01
err205
errOAAI
errDzeroski, S; De Raedt, L; Driessens, K
err分享
err收藏
Impact of Age at Administration, Lysosomal Storage, and Transgene Regulatory Elements on AAV2/8-Mediated Rat Liver Transduction
err2012-03-13
err0
errOAAI
errGabriella Cotugno; Patrizia Annunziata; Maria Vittoria Barone; Marianthi Karali; Sandro Banfi; Alberto Auricchio
err分享
err收藏
err分享
err收藏
A novel multi-step Q-learning method to improve data efficiency for deep reinforcement learning一种提高深度强化学习数据效率的多步Q学习方法
err2019-07-01
err43
PREAI
errYuan, Yinlong; Yu, Zhu Liang; Gu, Zhenghui; Yeboah, Yao; Wei, Wu; Deng, Xiaoyan; Li, Jingcong; Li, Yuanqing
err分享
err收藏
Adaptive and large-scale service composition based on deep reinforcement learning
err2019-09-01
err50
errOAAI
errWang, Hongbing; Gu, Mingzhu; Yu, Qi; Tao, Yong; Li, Jiajie; Fei, Huanhuan; Yan, Jia; Zhao, Wei; Hong, Tianjing
err分享
err收藏
A comparison of sampling strategies for histological image analysis
err2012-01-01
err0
errOAAI
errAndré Homeyer; Andrea Schenk; Uta Dahmen; Olaf Dirsch; Hai Huang; Horst K. Hahn
err分享
err收藏
学者 查看更多内容