arrow
返回

Efficient algorithm for big data clustering on single machine

delete2020-01-08
delete68
PRE
AI
R
Rasim Alguliyev
R
Ramiz M. Aliguliyev *
L
Lyudmila Sukhostat
DOI:10.1049/trit.2019.0048delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Big data analysis requires the presence of large computing powers, which is not always feasible. And so, it became necessary to develop new clustering algorithms capable of such data processing. This study proposes a new parallel clustering algorithm based on the k-means algorithm. It significantly reduces the exponential growth of computations. The proposed algorithm splits a dataset into batches while preserving the characteristics of the initial dataset and increasing the clustering speed. The idea is to define cluster centroids, which are also clustered, for each batch. According to the obtained centroids, the data points belong to the cluster with the nearest centroid. Real large datasets are used to conduct the experiments to evaluate the effectiveness of the proposed approach. The proposed approach is compared with k-means and its modification. The experiments show that the proposed algorithm is a promising tool for clustering large datasets in comparison with the k-means algorithm.
Keyword:
BATCH
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

CAAI Transactions on Intelligence Technology 封面图
CAAI Transactions on Intelligence Technology
IF:
7.3
论文数:
663
被引数:
2.4K

机构

A
azerbaijan national academy of sciences (anas)
学者数:
1.3K
论文数: 1.4K
被引数: 0
引用论文

引用论文

err分享
err收藏
err分享
err收藏
err分享
err收藏
err分享
err收藏
err分享
err收藏
Clustering in large data sets with the limited memory bundle method
err2018-11-01
err20
PREAI
errKarmitsa, Napsu; Bagirov, Adil M.; Taheri, Sona
err分享
err收藏
学者 查看更多内容