arrow
返回

Sequential multi-headed attention for entity-based relational neural network

delete2022-02-10
delete0
PRE
AI
D
Dagmawi Moges *
J
Jiaxu Zhao
H
Hong Qu
DOI:10.1111/exsy.12945delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The capacity of relational interaction between high-level information and reason is the defining characteristic of human intelligence. Regardless of the remarkable progress in artificial intelligence, recent machine reading comprehension models still heavily rely on high-dimensional word-based distributed representations. Since these models employ statistical means to answer questions of complex textual corpus and employ an accuracy-based metric system, their learning capacity of the required skills is not guaranteed. To ensure the capacity of MRC models to learn the desired skills, explainability has become an emerging requirement. In this paper, we propose an end-to-end natural language reasoning model that is based on sets of high-level aggregated representations which promote operational explainability. To this end, sequential multi-head attention, and a loss regularization function is proposed. We show analysis of the proposed approach on two natural language reasoning oriented question and answering datasets (bAbI and NewsQA).
Keyword:
artificial intelligence
computational models for AI
natural language processing
relational learning over aggregated representations

期刊

Expert Systems 封面图
Expert Systems
IF:
2.3
论文数:
2.6K
被引数:
3.8K

机构

暂无机构信息
引用论文

引用论文

err分享
err收藏
VETEM — A Very Early Time Electromagnetic System
err2012-03-29
err0
PREAI
errLouise Pellerin; Victor F. Labson; M. Cathy Pfeifer; Hendrik T. Andersen; Alex Becker; Ki Ha Lee; H. Frank Morrison; H. David Mac Lean; Donald D. Snyder; Gregory A. Newman; Jonathan E. Nyquist; Alan C. Tripp; Philip E. Wannamaker; Michael S. Zhdanov; Stanley H. Ward; Walter L. Anderson; David V. Fitterman; Thomas P. Grover; David L. Wright
err分享
err收藏
Race and the histologic grade of prostate cancer
err1997-02-01
err0
PREAI
errVincent L. Freeman; Jaroslaw Leszczak; Richard S. Cooper
err分享
err收藏
err分享
err收藏
Requirements for distributed authoring and versioning on the World Wide Web
err1997-03-01
err0
errOAAI
errJ. A. Slein; F. Vitali; E. J. Whitehead; D. G. Durand
err分享
err收藏
YAC transgene-mediated olfactory receptor gene choiceYAC转基因介导的嗅觉受体基因选择
err2000-02-01
err0
errOAAI
errFarah A.W. Ebrahimi; James Edmondson; Rodney Rothstein; Andrew Chess
err分享
err收藏
In-depth phenotypic characterization of multicellular tumor spheroids: Effects of 5-Fluorouracil
err2017-11-15
err0
errOAAI
errAngélique Virgone-Carlotta; Manon Lemasson; Hichem C. Mertani; Jean-Jacques Diaz; Sylvain Monnier; Thomas Dehoux; Hélène Delanoë-Ayari; Charlotte Rivière; Jean-Paul Rieu
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
学者 查看更多内容