arrow
返回

Regularization and optimization in model-based clustering

delete2024-06-01
delete1
delete
OA
AI
R
Raphael Araujo Sampaio *
J
Joaquim Dias Garcia
M
Marcus Poggi
T
Thibaut Vidal
DOI:10.1016/j.patcog.2024.110310delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Due to their conceptual simplicity, k -means algorithm variants have been extensively used for unsupervised cluster analysis. However, one main shortcoming of these algorithms is that they essentially fit a mixture of identical spherical Gaussians to data that vastly deviates from such a distribution. In comparison, general Gaussian Mixture Models (GMMs) can fit richer structures but require estimating a quadratic number of parameters per cluster to represent the covariance matrices. This poses two main issues: (i) the underlying optimization problems are challenging due to their larger number of local minima, and (ii) their solutions can overfit the data. In this work, we design search strategies that circumvent both issues. We develop more effective optimization algorithms for general GMMs, and we combine these algorithms with regularization strategies that avoid overfitting. Through extensive computational analyses, we observe that optimization or regularization in isolation does not substantially improve cluster recovery. However, combining these techniques permits a completely new level of performance previously unachieved by k -means algorithm variants, unraveling vastly different cluster structures. These results shed new light on the current status quo between GMM and k -means methods and suggest the more frequent use of general GMMs for data exploration. To facilitate such applications, we provide open -source code as well as Julia packages (UNSUPERVISEDCLUSTERING.JL and REGULARIZEDCOVARIANCEMATRICES.JL) implementing the proposed techniques.
Keyword:
Clustering
Gaussian Mixture Models
Regularization
Optimization
Hybrid Genetic Algorithm
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

U
universite de montreal
学者数:
4.6W
论文数: 3.8W
被引数: 46
P
Polytechnique Montreal
学者数:
3.7K
论文数: 3.4K
被引数: 42
引用论文

引用论文

err分享
err收藏
A SNP-Based Linkage Map and QTL Identification for Resistance to Yam Anthracnose Disease (YAD) in Water Yam (Dioscorea alata)
err
IF0
err2020-05-22
err0
errOAAI
errKwabena Darkwa; Paterne AGRE; Bunmi Olasanmi; Olufisayo Kolade; Pierre Mournet; Antonio Lopez-Montes; David Dekoeyer; Patrick Adebola; Lava P. Kumar; Robert Asiedu; Asrat Asfaw
err分享
err收藏
Towards energy-autonomous wake-up receiver using Visible Light Communication
err2016-01-01
err0
errOAAI
errJoyce Sariol Ramos; Ilker Demirkol; Josep Paradells; Daniel Vossing; Karim M. Gad; Martin Kasemann
err分享
err收藏
PAP Inhibitor with In Vivo Efficacy Identified by Candida albicans Genetic Profiling of Natural Products
err2008-04-01
err0
errOAAI
errBo Jiang; Deming Xu; John Allocco; Craig Parish; John Davison; Karynn Veillette; Susan Sillaots; Wenqi Hu; Roberto Rodriguez-Suarez; Steve Trosok; Li Zhang; Yang Li; Fariba Rahkhoodaee; Tara Ransom; Nick Martel; Hao Wang; Daniel Gauvin; Judyann Wiltsie; Douglas Wisniewski; Scott Salowe; Jennifer Nielsen Kahn; Ming-Jo Hsu; Robert Giacobbe; George Abruzzo; Amy Flattery; Charles Gill; Phil Youngman; Ken Wilson; Gerald Bills; Gonzalo Platas; Fernando Pelaez; Maria Teresa Diez; Sarah Kauffman; Jeff Becker; Guy Harris; Paul Liberator; Terry Roemer
err分享
err收藏
Julia: A Fresh Approach to Numerical Computing朱莉娅: 一种新的数值计算方法
err2017-01-01
err3.6K
errOAAI
errBezanson, Jeff; Edelman, Alan; Karpinski, Stefan; Shah, Viral B.
err分享
err收藏
学者 查看更多内容