Preprocessing noisy imbalanced datasets using SMOTE enhanced with fuzzy rough prototype selection

Nele Verbiest

doi:10.1016/j.asoc.2014.05.023

Preprocessing noisy imbalanced datasets using SMOTE enhanced with fuzzy rough prototype selection

2014-09-01

69

PRE

AI

DOI：10.1016/j.asoc.2014.05.023

Original

Original request for help

Save

Abstract

En 中文

The Synthetic Minority Over Sampling TEchnique (SMOTE) is a widely used technique to balance imbalanced data. In this paper we focus on improving SMOTE in the presence of class noise. Many improvements of SMOTE have been proposed, mostly cleaning or improving the data after applying SMOTE. Our approach differs from these approaches by the fact that it cleans the data before applying SMOTE, such that the quality of the generated instances is better. After applying SMOTE we also carry out data cleaning, such that instances (original or introduced by SMOTE) that badly fit in the new dataset are also removed. To this goal we propose two prototype selection techniques both based on fuzzy rough set theory. The first fuzzy rough prototype selection algorithm removes noisy instances from the imbalanced dataset, the second cleans the data generated by SMOTE. An experimental evaluation shows that our method improves existing preprocessing methods for imbalanced classification, especially in the presence of noise. (C) 2014 Elsevier B.V. All rights reserved.

Keywords:

Imbalanced classification

SMOTE

Prototype selection

Fuzzy rough set theory

Preprocessing noisy imbalanced datasets using SMOTE enhanced with fuzzy rough prototype selection

Abstract

AI Summary

Journal

Organization