arrow
Return

Truth Discovery on Inconsistent Relational Data

delete2018-06-01
delete7
delete
OA
AI
J
Jizhou Sun
李建忠 (Jianzhong Li) *
H
Hong Gao
王宏志 (Hongzhi Wang)
DOI:10.26599/TST.2018.9010004delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
In this era of big data, data are often collected from multiple sources that have different reliabilities, and there is inevitable conflict with respect to the various information obtained when it relates to the the same object. One important task is to identify the most trustworthy value out of all the conflicting claims, and this is known as truth discovery. Existing truth discovery methods simultaneously identify the most trustworthy information and source reliability degrees and are based on the idea that more reliable sources often provide more trustworthy information, and vice versa. However, there are often semantic constrains defined upon relational database, which can be violated by a single data source. To remove violations, an important task is to repair data to satisfy the constrains, and this is known as data cleaning. The two problems above may coexist, but considering them together can provide some benefits, and to the authors knowledge, this has not yet been the focus of any research. In this paper, therefore, a schema-decomposing based method is proposed to simultaneously discover the truth and to clean the data, with the aim of improving accuracy. Experimental results using real world data sets of notebooks and mobile phones, as well as simulated data sets, demonstrate the effectiveness and efficiency of our proposed method.
Keywords:
inconsistent data
truth discovery
data cleaning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

T
Tsinghua Science and Technology
IF:
3.5
Papers:
987
Citations:
2.5K

Organization

H
harbin institute of technology
Scholars:
8.0W
Papers: 6.6W
Citations: 66