arrow
Return

Towards deep entity resolution via soft schema matching

delete2022-01-01
delete3
PRE
AI
C
Chenchen Sun *
D
Derong Shen
DOI:10.1016/j.neucom.2021.10.106delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Entity resolution (ER) leads a key role in data preprocessing. ER identifies records corresponding to the same real-world entity. Recent years have witnessed a growing trend of deep learning based ER (deep ER). However, previous deep ER works do not fully utilize schema semantics, since they either use hard schema matching or disregard schema matching. In this work, we flexibly exploit schema matching to enhance deep ER. We define and implement soft schema matching, where attributes are flexibly associated in probabilities. Attribute associations are generated by aggregating token connections in coarse deep ER. Then we incorporate soft schema matching into hierarchical attention networks for ER, which tremendously improves resolution quality, especially for complex data and corrupted data. Different attentions are utilized for particular sub-tasks in ER networks, such as self-attention for contextualization, inter-attention for alignment and intra-attention for weighting. Finally comprehensive experiments are run over common data, complex data and corrupted data. Evaluation results show that our approach surpasses previous works. (c) 2021 Elsevier B.V. All rights reserved.
Keywords:
Entity resolution
Soft schema matching
Deep learning
Attention network
Data preprocessing

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

T
Tianjin University of Technology
Scholars:
8.8K
Papers: 5.9K
Citations: 1.0W
N
northeastern university - china
Scholars:
3.1W
Papers: 2.7W
Citations: 37