arrow
Return

A clustering-based adaptive undersampling ensemble method for highly unbalanced data classification

delete2024-07-01
delete1
PRE
AI
X
Xiaohan Yuan
C
Chuan Sun *
S
Shuyu Chen
DOI:10.1016/j.asoc.2024.111659delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The class imbalance issue is prevalent in various practical classification tasks. A high unbalanced rate will significantly decrease the classification performance of unbalanced learning. However, existing methods for highly unbalanced data classification still face two key difficulties: (1) fairly learning key information, and (2) maintaining consistency. To address these difficulties, we propose a novel majority clustering -based adaptive undersampling enhanced ensemble classification method, which integrates undersampling and ensemble techniques. In the adaptive undersampling process, we first consider the spatial distribution of majority samples to ensure distribution consistency. We then consider an adaptive sampling rate and introduce a feedback mechanism to obtain more representative majority samples from each cluster. In the classifier ensemble process, multiple ensemble iterations are introduced to achieve fair attention to key information in different classes. Finally, six kinds of experiments are conducted on 17 real highly unbalanced datasets from multiple fields. Experimental results demonstrate that the proposed method outperforms existing methods in terms of effectiveness, robustness, and adaptability.
Keywords:
Highly unbalanced data
Cluster
Undersampling
Ensemble learning

Journal

Applied Soft Computing cover
Applied Soft Computing
IF:
6.6
Papers:
1.4W
Citations:
4.8W

Organization

C
Chongqing University
Scholars:
5.1W
Papers: 4.1W
Citations: 6.0W
N
Nanyang Technological University
Scholars:
4.9W
Papers: 4.8W
Citations: 8.1W
C
Chongqing Normal University
Scholars:
3.3K
Papers: 2.7K
Citations: 3.8K
researcher View more organizations
Cited Papers

Cited Papers

A novel early diagnostic framework for chronic diseases with class imbalance
err2022-05-21
err9
errOAAI
errYuan, Xiaohan; Chen, Shuyu; Chuan Sun; Lu Yuwen
errShare
errSave
New applications of ensembles of classifiers
err2003-12-01
err229
PREAI
errBarandela, R; Sánchez, JS; Valdovinos, RM
errShare
errSave
Retraction
err2002-11-08
err0
PREAI
errAnthony J. Horsewill; Nicholas H. Jones; R. Caciuffo
errShare
errSave
Equalization ensemble for large scale highly imbalanced data classification
err2022-04-01
err25
PREAI
errRen, Jinjun; Wang, Yuping; Mao, Mingqian; Cheung, Yiu-ming
errShare
errSave
errShare
errSave
Loss of Atg7 in Endothelial Cells Enhanced Cutaneous Wound Healing in a Mouse Model
err2020-05-01
err0
PREAI
errKe-Cheng Li; Chun-Hui Wang; Jing-Jiang Zou; Chen Qu; Xing-Li Wang; Xing-Song Tian; Hong-Wei Liu; Taixing Cui
errShare
errSave
Incremental Weighted Ensemble Broad Learning System for Imbalanced Data
err2022-12-01
err60
PREAI
errYang, Kaixiang; Yu, Zhiwen; Chen, C. L. Philip; Cao, Wenming; You, Jane; Wong, Hau-San
errShare
errSave
Water Potential and Its Components in Developing Sweet Cherry
err2014-07-01
err0
errOAAI
errChristine Schumann; Henrik Jürgen Schlegel; Eckhard Grimm; Moritz Knoche; Alexander Lang
errShare
errSave
Quantification of placental change in mouse models of preeclampsia using magnetic resonance microscopy
err2018-04-03
err0
errOAAI
errGabriele Bobek; Tim Stait-Gardner; William Price; Angela Makris; Annemarie Hennessy
errShare
errSave
researcher View more