arrow
Return

Possibilistic Data Cleaning

delete2022-12-01
delete6
delete
OA
AI
H
Henning Köehler
S
Sebastian Link *
DOI:10.1109/TKDE.2021.3062318delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Classical data cleaning performs a minimal set of operations on the data to satisfy the given integrity constraints. Often, this minimization is equivalent to vertex cover, for example when tuples can be removed due to the violation of functional dependencies. Classically, the uncertainty of tuples and constraints is ignored. We propose not to view data as dirty but the uncertainty information about data. Since probabilities are often unavailable and their treatment is limited due to correlations in the data, we investigate a qualitative approach to uncertainty. Tuples are assigned degrees of possibility with which they occur, and constraints are assigned degrees of certainty that say to which tuples they apply. Our approach is non-invasive to the data as we lower the possibility degree of tuples as little as possible. The new resulting qualitative version of vertex cover remains NP-hard. We establish an algorithm that is fixed-parameter tractable in the size of the qualitative vertex cover. Experiments with synthetic and real-world data show that our algorithm outperforms the classical algorithm proportionally to the available number of uncertainty degrees. By mining the certainty degrees with which constraints hold, our framework becomes applicable even when uncertainty information is unavailable.
Keywords:
Cleaning
Uncertainty
Maintenance engineering
Possibility theory
Data models
Semantics
Relational databases
Algorithm
constraint
data cleaning
database
fixed-parameter tractable
intractability
possibility theory
vertex cover
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.9K
Citations:
3.2W

Organization

U
University of Auckland
Scholars:
2.3W
Papers: 2.4W
Citations: 3.3W
M
Massey University
Scholars:
7.7K
Papers: 7.9K
Citations: 9.6K
Cited Papers

Cited Papers

Mechanisms of glucocorticoid action in bone cells
err2004-02-19
err0
PREAI
errAnne M. Delany; Yu Dong; Ernesto Canalis
errShare
errSave
CRISPR everywhere
err2016-03-09
err0
errOAAI
err
errShare
errSave
errShare
errSave
An Evaluation of Point-of-Care HbA1c, HbA1c Home Kits, and Glucose Management Indicator: Potential Solutions for Telehealth Glycemic Assessments
err2022-09-13
err0
errOAAI
errDessi P. Zaharieva; Ananta Addala; Priya Prahalad; Brianna Leverenz; Nora Arrizon-Ruiz; Victoria Y. Ding; Manisha Desai; Amy B. Karger; David M. Maahs
errShare
errSave
Treating lower extremity malperfusion syndrome in acute type A aortic dissection with endovascular revascularization followed by delayed aortic repair
err2022-06-01
err0
errOAAI
errElizabeth L. Norton; Felix Orelaru; Aroma Naeem; Xiaoting Wu; Karen M. Kim; David M. Williams; Shinichi Fukuhara; Himanshu J. Patel; G. Michael Deeb; Bo Yang
errShare
errSave
Pharmacological preconditioning of random-pattern skin flaps with local FK506 in nicotine-treated rats: interaction with nitric oxide system
err2009-12-01
err0
PREAI
errBehtash Ghazi Nezami; Sina Rahimpour; Setareh Sianati; Dina Kalbasi anaraki; Mahsa Sadeghi; Mehdi Ghasemi; Ahmad Reza Dehpour
errShare
errSave
The Frenkel line and supercritical technologies
err2015-01-23
err0
PREAI
errV. V. Brazhkin; A. G. Lyapin; V. N. Ryzhov; K. Trachenko; Yu. D. Fomin; E. N. Tsiok
errShare
errSave
researcher View more