arrow
返回

Distributed fuzzy clustering algorithm for mixed-mode data in Apache SPARK

delete2022-12-21
delete5
delete
OA
AI
Z
Zareen Alamgir *
DOI:10.1186/s40537-022-00671-7delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Fuzzy clustering is an invaluable data mining technique that allows each data point to belong to more than one cluster with some degree of membership. It is widely employed in exploratory data mining to discover overlapping communities in social networks, find structure in spectral data, and capture user interests in recommendation systems. Nowadays, the variety and volume of data are increasing at a tremendous rate. Data is power; the massive data, along with an effective technique, can unravel valuable information. The existing fuzzy clustering algorithms do not perform well on massive heterogeneous datasets. Processing an enormous amount of data is beyond the capacity of a single processor. The need of the hour is to develop fuzzy clustering techniques that can work on a distributed framework for Big Data processing and can handle heterogeneous data. In this research, we evaluate the performance of the recently proposed algorithm for the Fuzzy clustering of mixed-mode data FCMD-MD (D'Urso and Massari in Inf Sci 505:513-534, 2019) with different real-world datasets. We develop a distributed FCMD-MD, a fuzzy clustering algorithm for mixed-mode data in Apache SPARK. The experimental results show that the algorithm is scalable, performs well in a distributed environment, and clusters enormous heterogeneous data with high accuracy. We also compared the performance of distributed FCMD-MD and the distributed k-medoid algorithm.

期刊

Journal of Big Data 封面图
Journal of Big Data
IF:
6.4
论文数:
1.5K
被引数:
1.1W

机构

暂无机构信息
引用论文

引用论文

Comparing Fuzzy Partitions: A Generalization of the Rand Index and Related Measures
err2012-06-01
err86
errOAAI
errHuellermeier, Eyke; Rifqi, Maria; Henzgen, Sascha; Senge, Robin
err分享
err收藏
Low-complexity fuzzy relational clustering algorithms for Web mining
err2001-08-01
err282
PREAI
errKrishnapuram, R; Joshi, A; Nasraoui, O; Yi, LY
err分享
err收藏
err分享
err收藏
Efects Of Polluters From Fishmeal Industries In Bahia De Todos Santos, Baja California
err1986-03-06
err0
errOAAI
errI. Rivera-Duarte; K. Nishikawa-Kinamura; S.A. Sa|00F1|udo-Wilhelmy; J.A. Segovia-Zavala
err分享
err收藏
Major benthic communities of the south-west lagoon of New Caledonia
err1988-11-01
err0
PREAI
errP. Chardy; C. Chevillon; J. Clavier
err分享
err收藏
Apache Spark: A Unified Engine for Big Data ProcessingApache Spark: 用于大数据处理的统一引擎
err2016-10-28
err1.7K
PREAI
errZaharia, Matei; Xin, Reynold S.; Wendell, Patrick; Das, Tathagata; Armbrust, Michael; Dave, Ankur; Meng, Xiangrui; Rosen, Josh; Venkataraman, Shivaram; Franklin, Michael J.; Ghodsi, Ali; Gonzalez, Joseph; Shenker, Scott; Stoica, Ion
err分享
err收藏
err分享
err收藏
A Dimensionally Reduced Clustering Methodology for Heterogeneous Occupational Medicine Data Mining
err2015-10-01
err22
PREAI
errSaadaoui, Foued; Bertrand, Pierre R.; Boudet, Gil; Rouffiac, Karine; Dutheil, Frederic; Chamoux, Alain
err分享
err收藏
学者 查看更多内容