arrow
返回

DBCURE-MR: An efficient density-based clustering algorithm for large data using MapReduce

delete2014-06-01
delete83
PRE
AI
Y
Young-Hoon Kim
K
Kyuseok Shim *
M
Min-Soeng Kim
J
June Sup Lee
DOI:10.1016/j.is.2013.11.002delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Clustering is a useful data mining technique which groups data points such that the points within a single group have similar characteristics, while the points in different groups are dissimilar. Density-based clustering algorithms such as DBSCAN and OPTICS are one kind of widely used clustering algorithms. As there is an increasing trend of applications to deal with vast amounts of data, clustering such big data is a challenging problem. Recently, parallelizing clustering algorithms on a large cluster of commodity machines using the MapReduce framework have received a lot of attention. In this paper, we first propose the new density-based clustering algorithm, called DBCURE, which is robust to find clusters with varying densities and suitable for parallelizing the algorithm with MapReduce. We next develop DBCURE-MR, which is a parallelized DBCURE using MapReduce. While traditional density-based algorithms find each cluster one by one, our DBCURE-MR finds several clusters together in parallel. We prove that both DBCURE and DBCURE-MR find the clusters correctly based on the definition of density-based clusters. Our experimental results with various data sets confirm that DBCURE-MR finds clusters efficiently without being sensitive to the clusters with varying densities and scales up well with the MapReduce framework. (C) 2013 Published by Elsevier Ltd.
Keyword:
Clustering algorithm
Density-based clustering
Parallel algorithm
MapReduce

期刊

Enterprise Information Systems 封面图
Enterprise Information Systems
IF:
3.9
论文数:
2.8K
被引数:
1.8K

机构

S
seoul national university (snu)
学者数:
7.2W
论文数: 6.6W
被引数: 86
引用论文

引用论文

Metabolic adaptations in goat mammary tissue during long-term incomplete milking
err2009-06-01
err0
PREAI
errColin J. Wilde; David R. Blatchford; Christopher H. Knight; Malcolm Peaker
err分享
err收藏
Getting the measure of atom interferometry
err2015-09-19
err0
PREAI
errFranck Pereira; Dos Santos; Arnaud Landragin
err分享
err收藏
Drosophila Embryo Stage Annotation Using Label Propagation
err2013-12-01
err0
PREAI
errToma Kazmar; Evgeny Z. Kvon; Alexander Stark; Christoph H. Lampert
err分享
err收藏
err分享
err收藏
学者 查看更多内容