arrow
Return

How Complex Is Your Classification Problem?: A Survey on Measuring Classification Complexity

delete2019-09-13
delete140
PRE
AI
A
Ana Carolina Lorena *
L
Luís P. F. Garcia
J
Jens Lehmann
M
Marcílio C. P. de Souto
T
Tin Kam Ho
DOI:10.1145/3347711delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Characteristics extracted from the training datasets of classification problems have proven to be effective predictors in a number of meta-analyses. Among them, measures of classification complexity can be used to estimate the difficulty in separating the data points into their expected classes. Descriptors of the spatial distribution of the data and estimates of the shape and size of the decision boundary are among the known measures for this characterization. This information can support the formulation of new data-driven preprocessing and pattern recognition techniques, which can in turn be focused on challenges highlighted by such characteristics of the problems. This article surveys and analyzes measures that can be extracted from the training datasets to characterize the complexity of the respective classification problems. Their use in recent literature is also reviewed and discussed, allowing to prospect opportunities for future work in the area. Finally, descriptions are given on an R package named Extended Complexity Library (ECoL) that implements a set of complexity measures and is made publicly available.
Keywords:
Supervised machine learning
classification
complexity measures
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

ACM Computing Surveys cover
ACM Computing Surveys
IF:
28
Papers:
2.4K
Citations:
3.5W

Organization

I
instituto tecnologico de aeronautica (ita)
Scholars:
723
Papers: 605
Citations: 0
U
university of bonn
Scholars:
3.3W
Papers: 2.6W
Citations: 29
U
universidade de brasilia
Scholars:
1.1W
Papers: 7.3K
Citations: 5
C
comando-geral de tecnologia aeroespacial (cta)
Scholars:
1.4K
Papers: 1.1K
Citations: 0
U
universite de orleans
Scholars:
3.6K
Papers: 2.7K
Citations: 1
researcher View more organizations