arrow
Return

Object-based cluster validation with densities

delete2022-01-01
delete10
PRE
AI
B
Behnam Tavakkol
J
Jeongsub Choi
M
Myong K. Jeong *
DOI:10.1016/j.patcog.2021.108223delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Clustering validity indices are typically used as tools to find the correct number of clusters in a data set and/or to evaluate the quality of the clusters formed by clustering algorithms. Clustering validity in-dices measure separation and compactness of clusters. Typically, when applying a clustering algorithm, the input includes the number of clusters. After applying the algorithm with several different numbers of clusters, we determine the number of clusters to be the one with the best validity index. There are two types of clustering validity indices: external indices that are supervised, and internal indices that are un-supervised. The focus of this paper is on internal validity indices. Some existing internal validity indices capture the properties of the clusters by using representative statistics such as mean, variance, diameter, etc., however, these do not perform well when clusters have arbitrary shapes. One approach to overcome this issue is to use the density of the data objects in each cluster. That provides the advantage of captur-ing the full characteristics of the cluster which is most beneficial when there are clusters with arbitrary shapes. In the literature, a few density-based clustering validity indices have been proposed. However, some of them show poor performance when the clusters are not perfectly separated. Some others per-form poorly because they use only representative objects from each cluster instead of all objects. The contribution of this paper is an internal validity index named the object-based clustering validity index with densities (OCVD). OCVD is a single number that averages the density-based contribution of individ-ual data objects to both separation and compactness of clusters. The methodology behind calculating the density-based contributions of the objects is kernel density estimation. We show through several exper-iments that OCVD performs well in detecting the correct number of clusters in data sets with different cluster shapes including arbitrary shapes. (c) 2021 Elsevier Ltd. All rights reserved.
Keywords:
Clustering
Clustering validity index
Internal index
Density-based cluster validation
Unsupervised

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

R
rutgers university system
Scholars:
4.1W
Papers: 3.7W
Citations: 53
Stockton University cover
Stockton University
Scholars:
281
Papers: 248
Citations: 257
W
West Virginia University
Scholars:
1.4W
Papers: 1.1W
Citations: 1.2W
researcher View more organizations
Cited Papers

Cited Papers

Raman spectroscopy as a detection and analysis tool for in vitro specific targeting of pancreatic cancer cells by EGF‐conjugated, single‐walled carbon nanotubes
err2011-12-06
err0
PREAI
errAlokita Karmakar; Cornel Iancu; Dana Monica Bartos; Meena W. Mahmood; Anindya Ghosh; Yang Xu; Enkeleda Dervishi; Samuel L. Collom; Mariya Khodakovskaya; Thikra Mustafa; Fumiya Watanabe; Alexandru R. Biris; Yongbin Zhang; Syed F. Ali; Dan Casciano; Samar Hassen; Zeid Nima; Alexandru S. Biris
errShare
errSave
A tutorial on the cross-entropy method
err2005-02-01
err2.2K
PREAI
errDe Boer, PT; Kroese, DP; Mannor, S; Rubinstein, RY
errShare
errSave
Weathering effects on materials from historical stained glass windows
err2003-06-30
err0
errOAAI
errM. García-Heras; C. Gil; N. Carmona; M. A. Villegas
errShare
errSave
The Role of Multiple Large Shareholders in the Choice of Debt Source
err2016-11-04
err0
PREAI
errSabri Boubaker; Wael Rouatbi; Walid Saffar
errShare
errSave
Security Performance Analysis of Relay Networks Based on κ - μ Shadowed Channels with RHIs and CEEs
err2022-04-13
err0
errOAAI
errJiangfeng Sun; Xiaohong Wang; Yiwei Fang; Xinji Tian; Mingfu Zhu; Jiangtao Ou; Chengyuan Fan
errShare
errSave
researcher View more