arrow
Return

Mining predicate-based entailment rules using deep contextual architecture

delete2019-01-01
delete2
PRE
AI
M
Maosheng Guo *
张煜 (Yu Zhang)
D
Dezhi Zhao
T
Ting Liu
DOI:10.1016/j.neucom.2018.09.046delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Semantic inference plays an essential role in numerous Natural Language Processing (NLP) tasks, such as question answering, machine reading and text summarization. Reasoning in natural language is inseparable from the knowledge about inference, which is often represented in the form of predicate-based entailment rules. Many efforts have been dedicated to extracting entailment rules from text corpora by utilizing statistical methodology including distributional hypothesis and Latent Dirichlet Allocation (LDA). However, these studies could not give equal consideration to both coverage and accuracy of the mined rules, which brings instability to downstream applications. To solve this problem, this paper proposes a novel model named Deep Contextual Architecture (DCA), which is driven by Deep Belief Networks (DBNs), for the task of mining predicate-based inference rules from texts. Besides previously used statistical contextual information, we also involve semantic meanings represented by word embeddings into DBNs to learn topic level representation of predicates. Combining benefits from both kinds of information, the proposed DCA model shows potential for better modeling the context of predicates. Evaluation on public datasets demonstrates that our method outperforms several strong baselines. (C) 2018 Elsevier B.V. All rights reserved.
Keywords:
Entailment rules mining
Natural language inference
Knowledge acquisition
Deep belief networks
Deep neural networks
Artificial intelligence
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

H
harbin institute of technology
Scholars:
8.0W
Papers: 6.6W
Citations: 66