arrow
Return

Parallel batch k-means for Big data clustering

delete2021-02-01
delete21
PRE
AI
R
Rasim Alguliyev
R
Ramiz M. Aliguliyev
L
Lyudmila Sukhostat *
DOI:10.1016/j.cie.2020.107023delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The application of clustering algorithms is expanding due to the rapid growth of data volumes. Nevertheless, existing algorithms are not always effective because of high computational complexity. A new parallel batch clustering algorithm based on the k-means algorithm is proposed. The proposed algorithm splits a dataset into equal partitions and reduces the exponential growth of computations. The goal is to preserve the characteristics of the dataset while increasing the clustering speed. The centers of the clusters are calculated for each partition, which are merged and also clustered later. The approach to determine the optimal batch size is also considered. The statistical significance of the proposed approach is provided. Six experimental datasets are used to evaluate the effectiveness of the proposed parallel batch clustering. The obtained results are compared with the k-means algorithm. The analysis shows the practical applicability of the proposed algorithm to Big Data.
Keywords:
Big data
Clustering
Batch
K-means
Parallel batch clustering
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Computers and Industrial Engineering cover
Computers and Industrial Engineering
IF:
6.5
Papers:
1.0W
Citations:
3.8W

Organization

A
azerbaijan national academy of sciences (anas)
Scholars:
1.3K
Papers: 1.4K
Citations: 0
Cited Papers

Cited Papers

err
IF0
err
err0
PREAI
err
errShare
errSave
A Tabu search based clustering algorithm and its parallel implementation on Spark
err2018-02-01
err31
errOAAI
errLu, Yinhao; Cao, Buyang; Rego, Cesar; Glover, Fred
errShare
errSave
Automatic Field Detection of Western Corn Rootworm (Diabrotica virgifera virgifera; Coleoptera: Chrysomelidae) with a New Probe
err2020-08-01
err0
errOAAI
errZsolt Tóth; Miklós Tóth; Júlia Katalin Jósvai; Franciska Tóth; Norbert Flórián; Veronika Gergócs; Miklós Dombos
errShare
errSave
A Novel Sampling Model to Study the Epidemiology of Canine Leishmaniasis in an Urban Environment
err2021-03-08
err0
errOAAI
errLucy A. Parker; Lucrecia Acosta; Mariana Noel Gutierrez; Israel Cruz; Javier Nieto; Enrique Jorge Deschutter; Fernando Jorge Bornay-Llinares
errShare
errSave
errShare
errSave
errShare
errSave
researcher View more