.png){kind=icon}
.png){kind=icon}
返回
Mapreduce-Based Distributed Clustering Method Using CF plus Tree
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2020.2999085.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Clustering exceptionally large data sets is becoming a major challenge in data analytics with the continuous increase in their size. Summary-based clustering methods and distributed computing frameworks such as MapReduce can efficiently handle this challenge. These methods include BIRCH and its extension CF+-ERC. CF+-ERC can reduce the clustering time of large data sets by utilizing the structure of a CF+ tree. However, CF+-ERC is a sequential clustering method, so it cannot be used with multiple machines to reduce the clustering time. In this study, we propose a novel MapReduce-based distributed clustering method called CF+-ERC on MapReduce (CF+ERC_MR). It builds a CF+ tree for clustering an exceptionally large data set with a given threshold and finds the final clusters using MapReduce, which significantly reduces the clustering time. Further, our method is scalable with respect to the number of machines. The efficacy of this method is validated through not only its theoretical analysis but also in-depth experimental analysis of exceptionally large synthetic and real data sets. The experimental results demonstrate that the clustering speed of our approach is far superior to that of the existing clustering methods.
Keyword:
Clustering
BIRCH
CF tree
range query
very large data sets
MapReduce
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。