A Noise-Aware Method With Type Constraint Pattern for Neural Relation Extraction

doi:10.1109/TKDE.2021.3108547

A Noise-Aware Method With Type Constraint Pattern for Neural Relation Extraction

2021-01-01

4

PRE

AI

DOI：10.1109/TKDE.2021.3108547

Original

Original request for help

Save

Abstract

En 中文

Distant supervision is an efficient way to generate large-scale training data for relation extraction without human efforts. However, the accompanying challenges have been plaguing the advance of the extractor: (1) the automatically annotated labels for training data contain much noisy data and hurt the performance of the extractor; (2) the annotations, based on bag-level (cluster of sentences) instead of sentence-level (single sentence), are too coarse to train an accurate extractor; (3) hetergeneous sentences are hard for a denoising model to capture the underlying commonness among valid relational expressions. To address these issues, we bulid a novel sentence representation and craft reinforcement learning to select the expressive sentence for each relation mentioned in a bag. More specifically, we introduce entity-free sentence pattern incorporated with attentive type information. Furthermore, multiple interactions between entity-specific and entity-free representation are proposed to generate complementary sentence features (for challenge 3). Then we design a fine-grained reward function, and model the sentence selection process as an auction where different relations for a bag need to compete together to achieve the possession of a specific sentence based on its expressiveness. In this way, our model can be dynamically self-adapted, and eventually implements the accurate one-to-one mapping from a relation label to its chosen expressive sentence, which serves as training instances for the extractor (for challenge 1 and 2). The experimental results on two public datasets demonstrate the superiority of our model compared with current state-of-the-art methods for distantly supervised relation extraction.

Keywords:

Data mining

Training

Reinforcement learning

Noise reduction

Feature extraction

Training data

Encoding

Relation extraction

distant supervision

multi-instance multi-label

heterogeneous sentences

reinforcement learning

A Noise-Aware Method With Type Constraint Pattern for Neural Relation Extraction

Abstract

Journal

Organization