arrow
返回

Toolbox for Distance Estimation and Cluster Validation on Data With Missing Values

delete2022-01-01
delete4
delete
OA
AI
M
Marko Niemelä *
S
Sami Äyrämö
T
Tommi Kärkkäinen
DOI:10.1109/ACCESS.2021.3136435delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Missing data are unavoidable in the real-world application of unsupervised machine learning, and their nonoptimal processing may decrease the quality of data-driven models. Imputation is a common remedy for missing values, but directly estimating expected distances have also emerged. Because treatment of missing values is rarely considered in clustering related tasks and distance metrics have a central role both in clustering and cluster validation, we developed a new toolbox that provides a wide range of algorithms for data preprocessing, distance estimation, clustering, and cluster validation in the presence of missing values. All these are core elements in any comprehensive cluster analysis methodology. We describe the methodological background of the implemented algorithms and present multiple illustrations of their use. The experiments include validating distance estimation methods against selected reference methods and demonstrating the performance of internal cluster validation indices. The experimental results demonstrate the general usability of the toolbox for the straightforward realization of alternate data processing pipelines. Source code, data sets, results, and example macros are available on GitHub. https://github.com/markoniem/nanclustering_toolbox
Keyword:
Covariance matrices
Estimation
Clustering algorithms
Task analysis
Data preprocessing
Convergence
Clustering methods
Missing values
distance estimation
clustering
cluster validation

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

U
university of jyvaskyla
学者数:
6.3K
论文数: 6.8K
被引数: 12
引用论文

引用论文

err分享
err收藏
Evaluation of δ13C in Carbonaceous Aerosol Source Apportionment at a Rural Measurement Site
err2017-01-01
err0
errOAAI
errJohan Martinsson; August Andersson; Moa K. Sporre; Johan Friberg; Adam Kristensson; Erik Swietlicki; Pål-Axel Olsson; Kristina Eriksson Stenström
err分享
err收藏
Towards energy-autonomous wake-up receiver using Visible Light Communication
err2016-01-01
err0
errOAAI
errJoyce Sariol Ramos; Ilker Demirkol; Josep Paradells; Daniel Vossing; Karim M. Gad; Martin Kasemann
err分享
err收藏
Towards a wireless and fully-implantable ECoG system
err2013-06-01
err0
PREAI
errE. Tolstosheeva; J. Hoeffmann; J. Pistor; D. Rotermund; T. Schellenberg; D. Boll; T. Hertzberg; V. Gordillo-Gonzalez; S. Mandon; D. Peters-Drolshagen; M. Schneider; K. Pawelzik; A. Kreiter; S. Paul; W. Lang
err分享
err收藏
err分享
err收藏
ChainForge: A Visual Toolkit for Prompt Engineering and LLM Hypothesis Testing
err2024-05-11
err0
errOAAI
errIan Arawjo; Chelse Swoopes; Priyan Vaithilingam; Martin Wattenberg; Elena L. Glassman
err分享
err收藏
An extensive comparative study of cluster validity indices聚类有效性指标的广泛比较研究
err2013-01-01
err920
PREAI
errArbelaitz, Olatz; Gurrutxaga, Ibai; Muguerza, Javier; Perez, Jesus M.; Perona, Inigo
err分享
err收藏
学者 查看更多内容