arrow
Return

Pycol: A Python package for dataset complexity measures

delete2025-05-24
delete0
delete
OA
AI
D
Diogo Apóstolo *
M
Miriam Seoane Santos
A
Ana Carolina Lorena
P
Pedro Henriques Abreu
DOI:10.1016/j.neucom.2025.130311delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Class overlap presents a significant challenge to machine learning algorithms, especially when class imbalance is present. These factors contribute substantially to the complexity of classification tasks, particularly in realworld scenarios. As a result, measuring overlap is crucial, yet it remains difficult to quantify due to its intricate nature, since it can manifest and be measured in multiple ways. To help mitigate this, recent research has conceptualized a new taxonomy of class overlap measures, divided into multiple families, which allows researchers to obtain a more complete overview of the complexity of the datasets. In line with recent research, we introduce a new Python package for class overlap measurement named pycol. This package implements 29 overlap measures, divided into four overlap families specifically designed to capture class overlap in imbalanced real-world scenarios. This makes pycol an essential tool for researchers dealing with complex classification problems, providing robust solutions to quantify the joint-effect of class overlap and class imbalance effectively.
Keywords:
Complexity measures
Dataset complexity
Overlap
Imbalance
Meta-learning

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

U
Univ Coimbra
Scholars:
849
Papers: 398
Citations: 104
I
Inst Tecnol Aeronaut
Scholars:
20
Papers: 12
Citations: 2
U
Univ Porto
Scholars:
1.9K
Papers: 893
Citations: 282
researcher View more organizations