arrow
Return

Sequence-based undersampling: an algorithm for managing imbalanced datasets

delete2025-10-16
delete0
PRE
AI
B
Bastián Andres Troncoso *
J
José A. Mateo-Cortés
M
M. Julia Flores
F
Francisco J. Tapiador
DOI:10.7717/peerj-cs.3078delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Imbalanced datasets pose significant challenges in machine learning (ML), often leading to catastrophic failures in models that are insensitive to their statistical particularities. In regression using neural networks (NN), imbalance is particularly problematic due to the potential undersampling of extreme but important values. Traditional classification methods are ineffective with imbalanced datasets and fail to capture the structure of the problem. This article presents a novel approach to handling imbalanced data in general regression. The new preprocessing technique, called Sequence-Based Undersampling, leverages the spatial structure of the data to selectively remove overrepresented instances. The method is tested using quantitative precipitation estimates (QPE), a well-known case of imbalance distribution in earth physics. The technique demonstrates consistent improvements in model performance compared to existing methods. The results suggest that sequence-aware undersampling improves regression models and ML algorithms, providing a practical solution to a prevalent issue in data-driven research. This method can enhance current satellite precipitation algorithms, as satellite retrievals often exhibit a leptokurtic distribution with few cases of high rainfall rates, many low rates, and numerous no-rain occurrences-a paradigmatic case of an imbalanced dataset built sequentially through radar and radiometer measurements.
Keywords:
Imbalance
ML
IA
Regression
Earth sciences
Undersampling

Journal

PeerJ Computer Science cover
PeerJ Computer Science
IF:
2.5
Papers:
3.4K
Citations:
6.9K

Organization

U
universidad politecnica de madrid
Scholars:
1.4K
Papers: 666
Citations: 0
U
Universidad de Castilla-La Mancha
Scholars:
9.9K
Papers: 9.1K
Citations: 7
Cited Papers

Cited Papers

Pre-processing approaches for imbalanced distributions in regression
err2019-05-01
err64
PREAI
errBranco, Paula; Torgo, Luis; Ribeiro, Rita P.
errShare
errSave
Machine learning: Trends, perspectives, and prospects
err2015-07-17
err0
PREAI
errM. I. Jordan; T. M. Mitchell
errShare
errSave
Editorial
err2004-06-01
err0
PREAI
errNitesh V. Chawla; Nathalie Japkowicz; Aleksander Kotcz
errShare
errSave
Survey on deep learning with class imbalance
err2019-03-19
err1.5K
errOAAI
errJohnson, Justin M.; Khoshgoftaar, Taghi M.
errShare
errSave
researcher View more