arrow
返回

Mapreduce-Based Distributed Clustering Method Using CF plus Tree

delete2020-01-01
delete3
delete
OA
AI
H
Hyeong-Cheol Ryu
S
Sungwon Jung *
DOI:10.1109/ACCESS.2020.2999085delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Clustering exceptionally large data sets is becoming a major challenge in data analytics with the continuous increase in their size. Summary-based clustering methods and distributed computing frameworks such as MapReduce can efficiently handle this challenge. These methods include BIRCH and its extension CF+-ERC. CF+-ERC can reduce the clustering time of large data sets by utilizing the structure of a CF+ tree. However, CF+-ERC is a sequential clustering method, so it cannot be used with multiple machines to reduce the clustering time. In this study, we propose a novel MapReduce-based distributed clustering method called CF+-ERC on MapReduce (CF+ERC_MR). It builds a CF+ tree for clustering an exceptionally large data set with a given threshold and finds the final clusters using MapReduce, which significantly reduces the clustering time. Further, our method is scalable with respect to the number of machines. The efficacy of this method is validated through not only its theoretical analysis but also in-depth experimental analysis of exceptionally large synthetic and real data sets. The experimental results demonstrate that the clustering speed of our approach is far superior to that of the existing clustering methods.
Keyword:
Clustering
BIRCH
CF tree
range query
very large data sets
MapReduce
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
36.3W

机构

S
sogang university
学者数:
355
论文数: 152
被引数: 2.2K
引用论文

引用论文

Results of exploratory coring in Laguna Lake, Philippines
err1993-01-01
err0
PREAI
errP. G. Sly; M. N. Charlton; S. R. Joshi
err分享
err收藏
Building a Scalable System for Stealthy P2P-Botnet Detection
err2014-01-01
err61
PREAI
errZhang, Junjie; Perdisci, Roberto; Lee, Wenke; Luo, Xiapu; Sarfraz, Unum
err分享
err收藏
err分享
err收藏
err分享
err收藏
Increased medial orbitofrontal [18F]fluorodopa uptake in Parkinsonian impulse control disorders
err2012-02-05
err0
PREAI
errJuho Joutsa; Kirsti Martikainen; Solja Niemelä; Jarkko Johansson; Sarita Forsback; Juha O. Rinne; Valtteri Kaasinen
err分享
err收藏
Imaging Repressed Memories in Motor Conversion Disorder
err2007-02-01
err0
PREAI
errRichard A. A. Kanaan; Tom K. J. Craig; Simon C. Wessely; Anthony S. David
err分享
err收藏
学者 查看更多内容