S-Divergence-Based Internal Clustering Validation Index

doi:10.9781/ijimai.2023.10.001

S-Divergence-Based Internal Clustering Validation Index

2023-01-01

2

OA

AI

DOI：10.9781/ijimai.2023.10.001

原文链接

原文求助

摘要

En 中文

A clustering validation index (CVI) is employed to evaluate an algorithm's clustering results. Generally, CVI statistics can be split into three classes, namely internal, external, and relative cluster validations. Most of the existing internal CVIs were designed based on compactness (CM) and separation (SM). The distance between cluster centers is calculated by SM, whereas the CM measures the variance of the cluster. However, the SM between groups is not always captured accurately in highly overlapping classes. In this article, we devise a novel internal CVI that can be regarded as a complementary measure to the landscape of available internal CVIs. Initially, a database's clusters are modeled as a non-parametric density function estimated using kernel density estimation. Then the S-divergence (SD) and S-distance are introduced for measuring the SM and the CM, respectively. The SD is defined based on the concept of Hermitian positive definite matrices applied to density functions. The proposed internal CVI (PM) is the ratio of CM to SM. The PM outperforms the legacy measures presented in the literature on both superficial and realistic databases in various scenarios, according to empirical results from four popular clustering algorithms, including fuzzy k-means, spectral clustering, density peak clustering, and density-based spatial clustering applied to noisy data.

Keyword:

Cluster Validity Index

Generalized Mean

K-nearest Neighbors

S-distance

S-divergence

Spectral Clustering

Symmetry Favored

S-Divergence-Based Internal Clustering Validation Index

摘要

期刊

机构

引用论文