返回
Sequential multi-headed attention for entity-based relational neural network
DOI:10.1111/exsy.12945.png)
摘要
En 中文
The capacity of relational interaction between high-level information and reason is the defining characteristic of human intelligence. Regardless of the remarkable progress in artificial intelligence, recent machine reading comprehension models still heavily rely on high-dimensional word-based distributed representations. Since these models employ statistical means to answer questions of complex textual corpus and employ an accuracy-based metric system, their learning capacity of the required skills is not guaranteed. To ensure the capacity of MRC models to learn the desired skills, explainability has become an emerging requirement. In this paper, we propose an end-to-end natural language reasoning model that is based on sets of high-level aggregated representations which promote operational explainability. To this end, sequential multi-head attention, and a loss regularization function is proposed. We show analysis of the proposed approach on two natural language reasoning oriented question and answering datasets (bAbI and NewsQA).
Keyword:
artificial intelligence
computational models for AI
natural language processing
relational learning over aggregated representations
期刊
IF:
2.3
论文数:
2.6K
被引数:
3.8K
机构
暂无机构信息
引用论文
In-depth phenotypic characterization of multicellular tumor spheroids: Effects of 5-Fluorouracil
PLOS ONE
IF0

