arrow
Return

Stochastic limited memory bundle algorithm for clustering in big data

delete2025-04-24
delete0
delete
OA
AI
N
Napsu Karmitsa *
V
Ville-Pekka Eronen
M
Marko M. Mäkelä
T
Tapio Pahikkala
A
Antti Airola
DOI:10.1016/j.patcog.2025.111654delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Clustering is a crucial task in data mining and machine learning. In this paper, we propose an efficient algorithm, BIG-CLuST, for solving minimum sum-of-squares clustering problems in large and big datasets. We first develop a novel stochastic limited memory bundle algorithm (SLMBA) for large-scale nonsmooth finite-sum optimization problems and then formulate the clustering problem accordingly. The BIG-CLuST algorithm - a stochastic adaptation of the incremental clustering methodology - aims to find the global or a high-quality local solution for the clustering problem. It detects good starting points, i.e., initial cluster centers, for the SLMBA, applied as an underlying solver. We evaluate BIG-CLuST on several real-world datasets with numerous data points and features, comparing its performance with other clustering algorithms designed for large and big data. Numerical results demonstrate the efficiency of the proposed algorithm and the high quality of the found solutions on par with the best existing methods.
Keywords:
Clustering
Nonsmooth optimization
Nonconvex optimization
Stochastic gradient
Limited memory bundle method
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

U
Univ Turku
Scholars:
648
Papers: 357
Citations: 94