arrow
Return

A post-processing framework for class-imbalanced learning in a transductive setting

delete2024-09-01
delete0
PRE
AI
姜
姜震 (Zhen Jiang) *
Y
Yu Lu
L
Lingyun Zhao
Y
Yongzhao Zhan
Q
Qirong Mao
DOI:10.1016/j.eswa.2024.123832delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Traditional classification tasks suffer from the class-imbalanced problem, where some classes far outnumber others. To address this issue, existing class-imbalanced learning (CIL) methods either preprocess classimbalanced datasets or adapt traditional classification algorithms to the imbalanced class distribution. Inspired by the idea of transductive learning, we propose a post -processing framework called PPF for CIL. Distinct from existing CIL methods, PPF directly adjusts the predicted labels of test data to fit the imbalanced class distribution. Specifically, we relabel some test data according to their prediction probabilities so that the class proportion of test data is close to that of training data. The underlying assumption is that training and test data, drawn independently from one data space, should obey the same class distribution. Furthermore, we propose a Compact Prototype -based Nearest Neighbor (CPNN) algorithm to assist the original classifier with the adjustment. Instead of training a classifier, CPNN classifies test data according to their distances to a set of prototypes estimated on labeled data. Thus, it is computationally simple and relatively robust to class imbalance. As a general framework, PPF can be easily applied to both traditional classification and CIL algorithms. To validate the effectiveness of the proposed method, we conducted extensive experiments on a variety of classimbalanced datasets, using SVM and C4.5 as the original classifiers, respectively. Measured by F -measure, Gmean, and AUC, both PPF-SVM and PPF-C4.5 outperform 10 state-of-the-art CIL algorithms. Additionally, PPF further improved their performances when applied to 10 CIL algorithms.
Keywords:
Class-imbalanced learning
Post-processing
Class proportion
Compact prototype

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
3.0W
Citations:
10.2W

Organization

J
Jiangsu University
Scholars:
4.0W
Papers: 2.8W
Citations: 5.5W
Cited Papers

Cited Papers

errShare
errSave
Proteomic Analysis of Human Lens Epithelial Cells Exposed to Microwaves
err2007-12-21
err0
PREAI
errHong-Wu Li; Ke Yao; Hong-Ying Jin; Li-Xia Sun; De-Qiang Lu; Yi-Bo Yu
errShare
errSave
Operational optimization in a district heating system
err1995-05-01
err0
PREAI
errAtli Benonysson; Benny Bøhm; Hans F. Ravn
errShare
errSave
Arsenic removal from aqueous solutions by adsorption using novel MIL-53(Fe) as a highly efficient adsorbent
err2015-01-01
err0
PREAI
errTuan. A. Vu; Giang. H. Le; Canh. D. Dao; Lan. Q. Dang; Kien. T. Nguyen; Quang. K. Nguyen; Phuong. T. Dang; Hoa. T. K. Tran; Quang. T. Duong; Tuyen. V. Nguyen; Gun. D. Lee
errShare
errSave
LDAS: Local density-based adaptive sampling for imbalanced data classification
err2022-04-01
err33
PREAI
errYan, Yuanting; Jiang, Yifei; Zheng, Zhong; Yu, Chengjin; Zhang, Yiwen; Zhang, Yanping
errShare
errSave
Incremental learning for transductive support vector machine
err2023-01-01
err10
PREAI
errChen, Haiyan; Yu, Ying; Jia, Yizhen; Gu, Bin
errShare
errSave
researcher View more