Premium
New internal clustering validation measure for contiguous arbitrary‐shape clusters
Author(s) -
RojasThomas Juan Carlos,
Santos Matilde
Publication year - 2021
Publication title -
international journal of intelligent systems
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.291
H-Index - 87
eISSN - 1098-111X
pISSN - 0884-8173
DOI - 10.1002/int.22521
Subject(s) - cluster analysis , measure (data warehouse) , partition (number theory) , cluster (spacecraft) , computer science , pattern recognition (psychology) , single linkage clustering , data mining , determining the number of clusters in a data set , mathematics , correlation clustering , artificial intelligence , cure data clustering algorithm , combinatorics , programming language
In this study a new internal clustering validation index is proposed. It is based on a measure of the uniformity of the data in clusters. It uses the local density of each cluster, in particular, the normalized variability of the density within the clusters to find the ideal partition. The new validity measure allows it to capture the spatial pattern of the data and obtain the right number of clusters in an automatic way. This new approach, unlike the traditional one that usually identifies well‐separated compact clouds, works with arbitrary‐shape clusters that may be contiguous or even overlapped. The proposed clustering measure has been evaluated on nine artificial data sets, with different cluster distributions and an increasing number of classes, on three highly nonlinear data sets, and on 17 real data sets. It has been compared with nine well‐known clustering validation indices with very satisfactory results. This proves that including density in the definition of clustering validation indices may be useful to identify the right partition of arbitrary‐shape and different‐size clusters.