arrow
返回

Entity resolution based EM for integrating heterogeneous distributed probabilistic data

delete2015-09-01
delete4
PRE
AI
D
Dharavath Ramesh *
C
Chiranjeev Kumar
DOI:10.1016/j.jss.2015.05.035delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Distributed computing is linked and equated to the industrial revolution. Its transformational nature is, however, associated with significant instances in the form of internet of thing operations. Entity resolution (ER) is a problem of matching and resolving records that represent the same real world entity. This is a long-standing challenge in distributed databases and information retrieval as a statistic. In a centralized approach, the problem of ER has not been scaled well as large amount of data need to be sent to a central node. In this paper, we present an algorithm which deals with heterogeneous distributed probabilistic data (HDPD) and also reduces processing time in a distributed environment. We propose two different approaches. First, we explore this instance with a matching (identification) problem to integrate different data models with expectation-maximization (EM) algorithm. Second, we apply ER methodology for HDPD to achieve major performance in terms of response time to produce the outcome. We validate HDPD through experiments over a 100-node cluster that records significant performance improvements over naive approaches. This paper is expected to provide insights in to database organizations and new technological development for the growth of distributed environment. (C) 2015 Elsevier Inc. All rights reserved.
Keyword:
Heterogeneous database
Probabilistic data
Entity resolution
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Journal of Systems and Software 封面图
Journal of Systems and Software
IF:
4.1
论文数:
5.5K
被引数:
8.4K

机构

I
indian institute of technology system (iit system)
学者数:
9.5W
论文数: 9.9W
被引数: 93
引用论文

引用论文

The effects of community-based rehabilitation on stroke patients in China: a single-blind, randomized controlled multicentre trial
err2009-04-06
err0
PREAI
errJianJun Yu; YongShan Hu; Yi Wu; WenHua Chen; YuLian Zhu; Xiao Cui; WeiBo Lu; Qi Qi; PeiYu Qu; XiaoHua Shen
err分享
err收藏
Probing single electrons across 300-mm spin qubit wafers
err2024-05-01
err0
errOAAI
errSamuel Neyens; Otto K. Zietz; Thomas F. Watson; Florian Luthi; Aditi Nethwewala; Hubert C. George; Eric Henry; Mohammad Islam; Andrew J. Wagner; Felix Borjans; Elliot J. Connors; J. Corrigan; Matthew J. Curry; Daniel Keith; Roza Kotlyar; Lester F. Lampert; Mateusz T. Mądzik; Kent Millard; Fahd A. Mohiyaddin; Stefano Pellerano; Ravi Pillarisetty; Mick Ramsey; Rostyslav Savytskyy; Simon Schaal; Guoji Zheng; Joshua Ziegler; Nathaniel C. Bishop; Stephanie Bojarski; Jeanette Roberts; James S. Clarke
err分享
err收藏
Duplicate record detection: A survey
err2007-01-01
err1.2K
errOAAI
errElmagarmid, Ahmed K.; Ipeirotis, Panagiotis G.; Verykios, Vassilios S.
err分享
err收藏
没有更多内容