arrow
Return

Spatial Distribution-Based Imbalanced Undersampling

delete2022-01-01
delete23
PRE
AI
严远亭 (Yuanting Yan)
Y
Yuanwei Zhu
R
Ruiqing Liu
张议文 (Yiwen Zhang) *
张艳平 cover
张艳平 (Yanping Zhang)
L
Ling Zhang
DOI:10.1109/TKDE.2022.3161537delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Undersampling is one of the most popular techniques for dealing with class-imbalance problems. Various undersampling methods have emerged over the past few decades. Each of them exhibits the superiority in some scenarios. However, selecting representative majority-class samples such that the structures of the selected groups are maintained according to the underlying imbalanced distribution remains a challenge. For this purpose, this paper proposes Spatial Distribution-based UnderSampling (SDUS) for imbalanced learning. SDUS uses a supervised constructive process to learn majority-class local patterns in terms of sphere neighborhoods (SPN). Two sample selection strategies, specifically, a top-down strategy and a bottom-up strategy, are proposed for maintaining the distribution pattern of original data in selecting majority-class sample subsets from different perspectives. SDUS introduces an ensemble technique that improves learning performance by utilizing the diversity caused by the randomness of the local-pattern learning process. Numerical experiments on 38 typical datasets from KEEL repository and 13 state-of-the-art comparison methods demonstrate the effectiveness of SDUS in maintaining the underlying distribution characteristics for imbalanced undersampling. The implementation of the proposed SDUS in programming language Python is available at https://github.com/ytyancp/SDUS.
Keywords:
Training
Costs
Biological neural networks
Machine learning algorithms
Clustering algorithms
Signal processing algorithms
Proposals
Undersampling
imbalance
local pattern
sphere neighborhood
ensemble learning

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.8K
Citations:
3.2W

Organization

A
anhui university
Scholars:
1.9W
Papers: 1.2W
Citations: 24