arrow
Return

An automatic sampling ratio detection method based on genetic algorithm for imbalanced data classification

delete2021-03-01
delete18
PRE
AI
M
Ming Zheng *
T
Tong Li *
孙立平 cover
孙立平 (Liping Sun)
T
Taochun Wang
接
接标 (Biao Jie)
W
Weiyi Yang
M
Mingjing Tang *
DOI:10.1016/j.knosys.2021.106800delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Imbalanced data are a common phenomenon in both theoretical research and real-world applications. At a data level, standard classification algorithms cannot effectively learn and make predictions from imbalanced data, and this problem is generally solved by using oversampling, undersampling, or hybrid sampling methods. However, most of the current sampling methods use random sampling ratios, and the resulting classification performance can be undesirable and unstable. To obtain satisfactory and stable classification performance, we proposed three algorithms to automatically determine the sampling ratios for oversampling, undersampling, and hybrid sampling methods, based on a genetic algorithm. Experiments were performed to test the algorithms' effectiveness by utilizing five widely used standard classification algorithms on 14 different imbalanced datasets using two oversampling, two undersampling, and four hybrid sampling methods. The statistical test results showed that for all five standard classification algorithms, sampling methods that used our proposed algorithms achieved the best classification results. Using area under the receiver operating characteristic curve (AUC) as the evaluation metric, it was demonstrated that the proposed algorithms for automatically determining the sampling ratio outperformed the random sampling ratio. (C) 2021 Elsevier B.V. All rights reserved.
Keywords:
Imbalanced data classification
Sampling methods
Sampling ratio
Genetic algorithm
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

Y
Yunnan Agricultural University
Scholars:
6.2K
Papers: 2.7K
Citations: 6
A
Anhui Normal University
Scholars:
7.0K
Papers: 4.6K
Citations: 6.8K
Cited Papers

Cited Papers

Numerically optimized structures for dielectric asymmetric dual-grating laser accelerators
err2014-02-01
err0
PREAI
errA. Aimidula; M. A. Bake; F. Wan; B. S. Xie; C. P. Welsch; G. Xia; O. Mete; M. Uesaka; Y. Matsumura; M. Yoshida; K. Koyama
errShare
errSave
Diversified Sensitivity-Based Undersampling for Imbalance Classification Problems
err2015-11-01
err181
PREAI
errNg, Wing W. Y.; Hu, Junjie; Yeung, Daniel S.; Yin, Shaohua; Roli, Fabio
errShare
errSave
A novel ensemble method for classifying imbalanced data
err2015-05-01
err338
PREAI
errSun, Zhongbin; Song, Qinbao; Zhu, Xiaoyan; Sun, Heli; Xu, Baowen; Zhou, Yuming
errShare
errSave
Semi-Supervised Text Classification With Universum Learning
err2016-02-01
err63
PREAI
errLiu, Chien-Liang; Hsaio, Wen-Hoar; Lee, Chia-Hoang; Chang, Tao-Hsing; Kuo, Tsung-Hsun
errShare
errSave
A cost-sensitive decision tree approach for fraud detection
err2013-11-01
err231
PREAI
errSahin, Yusuf; Bulkan, Serol; Duman, Ekrem
errShare
errSave
Arsenic removal from aqueous solutions by adsorption using novel MIL-53(Fe) as a highly efficient adsorbent
err2015-01-01
err0
PREAI
errTuan. A. Vu; Giang. H. Le; Canh. D. Dao; Lan. Q. Dang; Kien. T. Nguyen; Quang. K. Nguyen; Phuong. T. Dang; Hoa. T. K. Tran; Quang. T. Duong; Tuyen. V. Nguyen; Gun. D. Lee
errShare
errSave
researcher View more