.png){kind=icon}
返回
Context-aware data quality assessment for big data
.png){kind=icon}
OA
AI
DOI：10.1016/j.future.2018.07.014.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Big data changed the way in which we collect and analyze data. In particular, the amount of available information is constantly growing and organizations rely more and more on data analysis in order to achieve their competitive advantage. However, such amount of data can create a real value only if combined with quality: good decisions and actions are the results of correct, reliable and complete data. In such a scenario, methods and techniques for the Data Quality assessment can support the identification of suitable data to process. If for traditional database numerous assessment methods are proposed, in the Big Data scenario new algorithms have to be designed in order to deal with novel requirements related to variety, volume and velocity issues. In particular, in this paper we highlight that dealing with heterogeneous sources requires an adaptive approach able to trigger the suitable quality assessment methods on the basis of the data type and context in which data have to be used. Furthermore, we show that in some situations it is not possible to evaluate the quality of the entire dataset due to performance and time constraints. For this reason, we suggest to focus the Data Quality assessment only on a portion of the dataset and to take into account the consequent loss of accuracy by introducing a confidence factor as a measure of the reliability of the quality assessment procedure. We propose a methodology to build a Data Quality adapter module, which selects the best configuration for the Data Quality assessment based on the user main requirements: time minimization, confidence maximization, and budget minimization. Experiments are performed by considering real data gathered from a smart city case study. (C) 2018 Elsevier B.V. All rights reserved.
Keyword:
Data quality
Big data
Context-awareness
Data profiling
DQ assessment
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
F
IF:
6.1
论文数:
6.8K
被引数:
2.3W
机构
引用论文
OPTIMAL CONTROL OF WASTEWATER TREATMENT PLANTS VIA INTEGRATED NEURAL NETWORK AND GENETIC ALGORITHMS
PREAI
分享收藏Multimodality Monitoring of Transcranial Electric Motor and Somatosensory-Evoked Potentials During Surgical Correction of Spinal Deformity in Patients With Cerebral Palsy and Other Neuromuscular Disorders.png)
Spine
SpineIF0
PREAI
分享收藏
查看更多内容