.png){kind=icon}
Return
Regularization and optimization in model-based clustering
.png){kind=icon}
OA
AI
DOI：10.1016/j.patcog.2024.110310.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Due to their conceptual simplicity, k -means algorithm variants have been extensively used for unsupervised cluster analysis. However, one main shortcoming of these algorithms is that they essentially fit a mixture of identical spherical Gaussians to data that vastly deviates from such a distribution. In comparison, general Gaussian Mixture Models (GMMs) can fit richer structures but require estimating a quadratic number of parameters per cluster to represent the covariance matrices. This poses two main issues: (i) the underlying optimization problems are challenging due to their larger number of local minima, and (ii) their solutions can overfit the data. In this work, we design search strategies that circumvent both issues. We develop more effective optimization algorithms for general GMMs, and we combine these algorithms with regularization strategies that avoid overfitting. Through extensive computational analyses, we observe that optimization or regularization in isolation does not substantially improve cluster recovery. However, combining these techniques permits a completely new level of performance previously unachieved by k -means algorithm variants, unraveling vastly different cluster structures. These results shed new light on the current status quo between GMM and k -means methods and suggest the more frequent use of general GMMs for data exploration. To facilitate such applications, we provide open -source code as well as Julia packages (UNSUPERVISEDCLUSTERING.JL and REGULARIZEDCOVARIANCEMATRICES.JL) implementing the proposed techniques.
Keywords:
Clustering
Gaussian Mixture Models
Regularization
Optimization
Hybrid Genetic Algorithm
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
7.6
Papers:
1.3W
Citations:
4.5W
Organization
Cited Papers
.png){kind=icon}
ShareSave
ShareSaveShareSaveShareSaveShareSaveShareSave
View more