.png){kind=icon}
返回
Applying machine learning techniques for scaling out data quality algorithms in cloud computing environments
.png){kind=icon}
PRE
AI
DOI：10.1007/s10489-016-0774-2.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Deduplication is the task of identifying the entities in a data set which refer to the same real world object. Over the last decades, this problem has been largely investigated and many techniques have been proposed to improve the efficiency and effectiveness of the deduplication algorithms. As data sets become larger, such algorithms may generate critical bottlenecks regarding memory usage and execution time. In this context, cloud computing environments have been used for scaling out data quality algorithms. In this paper, we investigate the efficacy of different machine learning techniques for scaling out virtual clusters for the execution of deduplication algorithms under predefined time restrictions. We also propose specific heuristics (Best Performing Allocation, Probabilistic Best Performing Allocation, Tunable Allocation, Adaptive Allocation and Sliced Training Data) which, together with the machine learning techniques, are able to tune the virtual cluster estimations as demands fluctuate over time. The experiments we have carried out using multiple scale data sets have provided many insights regarding the adequacy of the considered machine learning algorithms and proposed heuristics for tackling cloud computing provisioning.
Keyword:
Data quality
Deduplication
Machine learning
Heuristics
Cloud computing
Elasticity
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.5
论文数:
7.6K
被引数:
1.7W
机构
引用论文
Total Synthesis of Kendomycin Featuring Intramolecular Dötz Benzannulation具有分子内d ö tz苯并环的Kendomycin的全合成
PREAI
分享收藏Long non-coding RNA TUG1 promotes cervical cancer progression by regulating the miR-138-5p-SIRT1 axis.png)
Oncotarget
OAAI
OncotargetIF0
OAAI分享收藏
A dynamic programming approach to missing data estimation using neural networks使用神经网络进行缺失数据估计的动态规划方法
PREAI
分享收藏
查看更多内容