arrow
Return

A genetic algorithm based entity resolution approach with active learning

delete2017-04-07
delete2
PRE
AI
C
Chenchen Sun *
D
Derong Shen
Y
Yue Kou
T
Tiezheng Nie
G
Ge Yu
DOI:10.1007/s11704-015-5276-6delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Entity resolution is a key aspect in data quality and data integration, identifying which records correspond to the same real world entity in data sources. Many existing approaches require manually designed match rules to solve the problem, which always needs domain knowledge and is time consuming. We propose a novel genetic algorithm based entity resolution approach via active learning. It is able to learn effective match rules by logically combining several different attributes' comparisons with proper thresholds. We use active learning to reduce manually labeled data and speed up the learning process. The extensive evaluation shows that the proposed approach outperforms the sate-of-the-art entity resolution approaches in accuracy.
Keywords:
entity resolution
genetic algorithm
active learning
data quality
data integration

Journal

Frontiers of Computer Science cover
Frontiers of Computer Science
IF:
4.6
Papers:
1.6K
Citations:
2.8K

Organization

N
northeastern university - china
Scholars:
3.2W
Papers: 2.7W
Citations: 37
Cited Papers

Cited Papers

Big data challenge: a data management perspective
err2013-04-06
err204
PREAI
errChen, Jinchuan; Chen, Yueguo; Du, Xiaoyong; Li, Cuiping; Lu, Jiaheng; Zhao, Suyun; Zhou, Xuan
errShare
errSave
errShare
errSave
errShare
errSave
Effect of energy source during culture on in vitro embryo development, resistance to cryopreservation and sex ratio
err2011-10-01
err0
PREAI
errMarcello Rubessa; Lucia Boccia; Giuseppe Campanile; Valentina Longobardi; Sara Albarella; Alessandra Tateo; Luigi Zicarelli; Bianca Gasparrini
errShare
errSave
A Genetic Programming Approach to Record Deduplication
err2012-03-01
err45
PREAI
errde Carvalho, Moises G.; Laender, Alberto H. F.; Goncalves, Marcos Andre; da Silva, Altigran S.
errShare
errSave
Duplicate record detection: A survey
err2007-01-01
err1.2K
errOAAI
errElmagarmid, Ahmed K.; Ipeirotis, Panagiotis G.; Verykios, Vassilios S.
errShare
errSave
Increased endothelial microparticles in obese and overweight children
err2012-01-01
err0
PREAI
errZübeyde Gündüz; İsmail Dursun; Sebahat Tülpar; Funda Baştuğ; Ali Baykan; Ali Yıkılmaz; Türkan Patıroğlu; Hakan M. Poyrazoglu; Leyla Akın; Sibel Yel; Ruhan Düşünsel
errShare
errSave
The complete genome sequence of the Gram-positive bacterium Bacillus subtilis
err1997-11-01
err0
errOAAI
errF. Kunst; N. Ogasawara; I. Moszer; A. M. Albertini; G. Alloni; V. Azevedo; M. G. Bertero; P. Bessières; A. Bolotin; S. Borchert; R. Borriss; L. Boursier; A. Brans; M. Braun; S. C. Brignell; S. Bron; S. Brouillet; C. V. Bruschi; B. Caldwell; V. Capuano; N. M. Carter; S.-K. Choi; J.-J. Codani; I. F. Connerton; N. J. Cummings; R. A. Daniel; F. Denizot; K. M. Devine; A. Düsterhöft; S. D. Ehrlich; P. T. Emmerson; K. D. Entian; J. Errington; C. Fabret; E. Ferrari; D. Foulger; C. Fritz; M. Fujita; Y. Fujita; S. Fuma; A. Galizzi; N. Galleron; S.-Y. Ghim; P. Glaser; A. Goffeau; E. J. Golightly; G. Grandi; G. Guiseppi; B. J. Guy; K. Haga; J. Haiech; C. R. Harwood; A. Hénaut; H. Hilbert; S. Holsappel; S. Hosono; M.-F. Hullo; M. Itaya; L. Jones; B. Joris; D. Karamata; Y. Kasahara; M. Klaerr-Blanchard; C. Klein; Y. Kobayashi; P. Koetter; G. Koningstein; S. Krogh; M. Kumano; K. Kurita; A. Lapidus; S. Lardinois; J. Lauber; V. Lazarevic; S.-M. Lee; A. Levine; H. Liu; S. Masuda; C. Mauël; C. Médigue; N. Medina; R. P. Mellado; M. Mizuno; D. Moestl; S. Nakai; M. Noback; D. Noone; M. O'Reilly; K. Ogawa; A. Ogiwara; B. Oudega; S.-H. Park; V. Parro; T. M. Pohl; D. Portetelle; S. Porwollik; A. M. Prescott; E. Presecan; P. Pujic; B. Purnelle; G. Rapoport; M. Rey; S. Reynolds; M. Rieger; C. Rivolta; E. Rocha; B. Roche; M. Rose; Y. Sadaie; T. Sato; E. Scanlan; S. Schleich; R. Schroeter; F. Scoffone; J. Sekiguchi; A. Sekowska; S. J. Seror; P. Serror; B.-S. Shin; B. Soldo; A. Sorokin; E. Tacconi; T. Takagi; H. Takahashi; K. Takemaru; M. Takeuchi; A. Tamakoshi; T. Tanaka; P. Terpstra; A. Tognoni; V. Tosato; S. Uchiyama; M. Vandenbol; F. Vannier; A. Vassarotti; A. Viari; R. Wambutt; E. Wedler; H. Wedler; T. Weitzenegger; P. Winters; A. Wipat; H. Yamamoto; K. Yamane; K. Yasumoto; K. Yata; K. Yoshida; H.-F. Yoshikawa; E. Zumstein; H. Yoshikawa; A. Danchin
errShare
errSave
no more