arrow
Return

A method for resampling imbalanced datasets in binary classification tasks for real-world problems

delete2014-07-01
delete140
PRE
AI
S
Silvia Cateni
V
Valentina Colla *
M
Marco Vannucci
DOI:10.1016/j.neucom.2013.05.059delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The paper presents a novel resampling method for binary classification problems on imbalanced datasets. Imbalanced datasets are frequently found in many industrial applications: for instance, the occurrence of particular product defects, the diagnosis of severe diseases in a series of patients or machine faults are rare events whose detection is of utmost importance. In this paper a new resampling method is proposed combining an oversampling and an undersampling technique. Several tests have been developed aiming at assessing the efficiency of the proposed method. Four classifiers based, respectively, on Support Vector Machine, Decision Tree, labelled Self-Organizing Map and Bayesian Classifiers have been developed and applied for binary classification on the following four datasets: a synthetic dataset, a widely used public dataset and two datasets coming from industrial applications. The results that have been obtained in the tests are presented and discussed in the paper; in particular, the performances that are achieved by the four classifiers through the proposed novel resampling approach have been compared to the ones that are obtained, without any resampling, through a widely applied and well known resampling technique, i.e. the classical SMOTE approach, and through another approach coupling informed SMOTE-based oversampling and informed clustering-based undersampling. (C) 2014 Elsevier B.V. All rights reserved.
Keywords:
Oversampling
Undersampling
Imbalanced dataset

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

No organization information available
Cited Papers

Cited Papers

A series of transition metal coordination polymers based on a rigid bi-functional carboxylate–triazolate tecton
err2017-01-01
err0
PREAI
errNan-nan Mao; Peng Hu; Fan Yu; Xi Chen; Gui-lin Zhuang; Tian-le Zhang; Bao Li
errShare
errSave
Arsenic removal from aqueous solutions by adsorption using novel MIL-53(Fe) as a highly efficient adsorbent
err2015-01-01
err0
PREAI
errTuan. A. Vu; Giang. H. Le; Canh. D. Dao; Lan. Q. Dang; Kien. T. Nguyen; Quang. K. Nguyen; Phuong. T. Dang; Hoa. T. K. Tran; Quang. T. Duong; Tuyen. V. Nguyen; Gun. D. Lee
errShare
errSave
Optimal Design of Prestressed Concrete Poles
err1972-01-01
err0
PREAI
errManhar C. Thakkar; Bakul S. Bulsari
errShare
errSave
Room-temperature direct band-gap electroluminescence from germanium (111)-fin light-emitting diodes
err2017-02-07
err0
errOAAI
errKazuki Tani; Shin-ichi Saito; Katsuya Oda; Makoto Miura; Yuki Wakayama; Tadashi Okumura; Toshiyuki Mine; Tatemi Ido
errShare
errSave
Aetiological Significance of Infectious Stimuli in Kawasaki Disease
err2019-06-28
err0
errOAAI
errAkihiro Nakamura; Kazuyuki Ikeda; Kenji Hamaoka
errShare
errSave
researcher View more