arrow
返回

A cluster impurity-based hybrid resampling for imbalanced classification problems

delete2024-07-20
delete2
PRE
AI
Y
You‐Jin Park *
K
Ke-Yong Cheng
DOI:10.1007/s10489-024-05644-2delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
As one of the supervised learning techniques, classification plays a crucial role in categorizing and predicting the observations across a wide range of machine learning applications such as software defect detection, fraud detection in financial sector, fault and defect detection in manufacturing industry, medical diagnosis, etc. However, most classification algorithms have been developed with the assumption that the class distribution is balanced although unequal class distributions are quite common in many practical cases. When a class imbalance problem exists, in general, the classifier tends to become biased towards the majority class and thus the minority class instances are often misclassified to the majority class. Along with the class imbalance problem, the class overlap is also known as one of the sources that makes the learning task become difficult or sometimes deteriorates the classification performance, especially, when class imbalance problem also exists. Thus, in this research, we propose a cluster impurity-based hybrid resampling method including the partially balanced strategy to improve the classification performance of class imbalanced data with considering intra-cluster class imbalance and inter-cluster overlap problems. Specifically, several clustering methods are employed for identifying the groups (i.e., clusters) of all the instances and the cluster impurity of each instance is computed for measuring the degree of cluster overlap. Then, based on the cluster impurity, the instances are generated and eliminated recursively. To demonstrate the effectiveness of the proposed method, comprehensive experiments are conducted on forty imbalanced datasets and two non-parametric hypothesis tests are employed to show the statistical difference in classification performances between the proposed method and other traditional resampling methods.
Keyword:
Imbalanced classification problem
Hybrid resampling
Intra-cluster class imbalance
Inter-cluster overlap
Cluster impurity
Machine learning

期刊

Applied Intelligence 封面图
Applied Intelligence
IF:
3.5
论文数:
7.6K
被引数:
1.7W

机构

N
National Taipei University of Technology
学者数:
7.1K
论文数: 7.3K
被引数: 6.8K
引用论文

引用论文

Combustor Miniaturization with Liquid-Fuel Filming
err2003-11-11
err0
PREAI
errSimone Stanchi; Derek Dunn-Rankin; William Sirignano
err分享
err收藏
Emerging Role of (Endo)Cannabinoids in Migraine
err2018-04-24
err0
errOAAI
errPinja Leimuranta; Leonard Khiroug; Rashid Giniatullin
err分享
err收藏
Operational optimization in a district heating system
err1995-05-01
err0
PREAI
errAtli Benonysson; Benny Bøhm; Hans F. Ravn
err分享
err收藏
The impact of class imbalance in classification performance metrics based on the binary confusion matrix
err2019-07-01
err590
errOAAI
errLuque, Amalia; Carrasco, Alejandro; Martin, Alejandro; de las Heras, Ana
err分享
err收藏
Strong Duality in Cone Constrained Nonconvex Optimization
err2013-01-01
err0
PREAI
errFabián Flores-Bazán; Giandomenico Mastroeni
err分享
err收藏
Modeling of Discontinuous Relationships in Biology with Censored Regression
err1994-03-01
err0
PREAI
errBernhard Schmid; Wolfgang Polasek; Jacob Weiner; Andreas Krause; Peter Stoll
err分享
err收藏
Arsenic removal from aqueous solutions by adsorption using novel MIL-53(Fe) as a highly efficient adsorbent使用新型MIL-53(Fe) 作为高效吸附剂通过吸附从水溶液中去除砷
err2015-01-01
err0
PREAI
errTuan. A. Vu; Giang. H. Le; Canh. D. Dao; Lan. Q. Dang; Kien. T. Nguyen; Quang. K. Nguyen; Phuong. T. Dang; Hoa. T. K. Tran; Quang. T. Duong; Tuyen. V. Nguyen; Gun. D. Lee
err分享
err收藏
学者 查看更多内容