arrow
Return

An Attention-Based Word-Level Interaction Model for Knowledge Base Relation Detection

delete2018-01-01
delete14
delete
OA
AI
H
Hongzhi Zhang
G
Guandong Xu
肖亮 cover
肖亮 (Liang Xiao)
G
Guangluan Xu
李峰 (Feng Li)
K
Kun Fu
L
Lei Wang
T
Tinglei Huang *
DOI:10.1109/ACCESS.2018.2883304delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Relation detection plays a crucial role in knowledge base question answering, and it is challenging because of the high variance of relation expression in real-world questions. Traditional relation detection models based on deep learning follow an encoding-comparing paradigm, where the question and the candidate relation are represented as vectors to compare their semantic similarity. Max- or average-pooling operation, which is used to compress the sequence of words into fixed-dimensional vectors, becomes the bottleneck of information flow. In this paper, we propose an attention-based word-level interaction model (ABWIM) to alleviate the information loss issue caused by aggregating the sequence into a fixed-dimensional vector before the comparison. First, attention mechanism is adopted to learn the soft alignments between words from the question and the relation. Then, fine-grained comparisons are performed on the aligned words. Finally, the comparison results are merged with a simple recurrent layer to estimate the semantic similarity. Besides, a dynamic sample selection strategy is proposed to accelerate the training procedure without decreasing the performance. Experimental results of relation detection on both SimpleQuestions and WebQuestions datasets show that ABWIM achieves the state-of-the-art accuracy, demonstrating its effectiveness.
Keywords:
Relation detection
knowledge base question answering
word-level interaction
attention
dynamic sample selection
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

I
institute of electronics, cas
Scholars:
179
Papers: 179
Citations: 0
C
chinese academy of sciences
Scholars:
56.5W
Papers: 44.9W
Citations: 704