Parallel random swap: An efficient and reliable clustering algorithm in java

doi:10.1016/j.simpat.2022.102712

Return

Parallel random swap: An efficient and reliable clustering algorithm in java

2023-04-01

PRE

Libero Nigro *

Franco Cicirelli

Fra, Pasi

DOI：10.1016/j.simpat.2022.102712

Original

Original request for help

Save

Abstract

En 中文

Solving large-scale clustering problems requires an efficient algorithm that can also be implemented in parallel. K-means would be suitable, but it can lead to an inaccurate clustering result. To overcome this problem, we present a parallel version of the random swap clustering algorithm. It combines the scalability of k-means with the high clustering accuracy of random swap. The algorithm is implemented in Java in two ways. The first implementation uses Java parallel streams and lambda expressions. The solution exploits a built-in multi-threaded organization capable of offering competitive speedup. The second implementation is achieved on top of the Theatre actor system which ensures better scalability and high-performance computing through fine-grain resource control. The two implementations are then applied to standard benchmark datasets, with a varying population size and distribution of managed records, dimensionality of data points and the number of clusters. The experimental results confirm that high-quality clustering can be obtained together with a very good execution efficiency. Our Java code is publicly available at: https://github.com/uef-machine-learning.

Keywords:

Clustering problem

K -means

Random swap

Parallelism

Java

Streams

Lambda expressions

Actors

Multi -core machines