arrow
Return

Self-selective attention using correlation between instances for distant supervision relation extraction

delete2021-10-01
delete23
PRE
AI
Y
Yanru Zhou
潘丽敏 (Limin Pan)
C
Chongyou Bai
S
Senlin Luo *
DOI:10.1016/j.neunet.2021.04.032delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Distant supervision relation extraction methods are widely used to extract relational facts in text. The traditional selective attention model regards instances in the bag as independent of each other, which makes insufficient use of correlation information between instances and supervision information of all correctly labeled instances, affecting the performance of relation extractor. Aiming at this problem, a distant supervision relation extraction method with self-selective attention is proposed. The method uses a layer of convolution and self-attention mechanism to encode instances to learn the better semantic vector representation of instances. The correlation between instances in the bag is used to assign a higher weight to all correctly labeled instances, and the weighted summation of instances in the bag is used to obtain a bag vector representation. Experiments on the NYT dataset show that the method can make full use of the information of all correctly labeled instances in the bag. The method can achieve better results as compared with baselines. (C) 2021 Elsevier Ltd. All rights reserved.
Keywords:
Distant supervision relation extraction
Convolution neural network
Self-attention mechanism
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neural Networks cover
Neural Networks
IF:
6.3
Papers:
7.8K
Citations:
3.0W

Organization

B
beijing institute of technology
Scholars:
5.4W
Papers: 4.0W
Citations: 63