arrow
Return

Combating the Small Sample Class Imbalance Problem Using Feature Selection

delete2010-10-01
delete287
PRE
AI
X
Xuewen Chen
DOI:10.1109/TKDE.2009.187delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The class imbalance problem is encountered in real-world applications of machine learning and results in a classifier's suboptimal performance. Researchers have rigorously studied the resampling, algorithms, and feature selection approaches to this problem. No systematic studies have been conducted to understand how well these methods combat the class imbalance problem and which of these methods best manage the different challenges posed by imbalanced data sets. In particular, feature selection has rarely been studied outside of text classification problems. Additionally, no studies have looked at the additional problem of learning from small samples. This paper presents a first systematic comparison of the three types of methods developed for imbalanced data classification problems and of seven feature selection metrics evaluated on small sample data sets from different applications. We evaluated the performance of these metrics using area under the receiver operating characteristic (AUC) and area under the precision-recall curve (PRC). We compared each metric on the average performance across all problems and on the likelihood of a metric yielding the best performance on a specific problem. We examined the performance of these metrics inside each problem domain. Finally, we evaluated the efficacy of these metrics to see which perform best across algorithms. Our results showed that signal-to-noise correlation coefficient (S2N) and Feature Assessment by Sliding Thresholds (FAST) are great candidates for feature selection in most applications, especially when selecting very small numbers of features.
Keywords:
Class imbalance problem
feature evaluation and selection
machine learning
pattern recognition
bioinformatics
text mining
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.8K
Citations:
3.2W

Organization

U
University of Kansas
Scholars:
1.9W
Papers: 1.7W
Citations: 8.1K
Cited Papers

Cited Papers

Type II collagen–specific antibodies induce cartilage damage in mice independent of inflammation
err2013-02-25
err0
PREAI
errAllyson M. Croxford; Senga Whittingham; Donald McNaughton; Kutty Selva Nandakumar; Rikard Holmdahl; Merrill J. Rowley
errShare
errSave
Arsenic removal from aqueous solutions by adsorption using novel MIL-53(Fe) as a highly efficient adsorbent
err2015-01-01
err0
PREAI
errTuan. A. Vu; Giang. H. Le; Canh. D. Dao; Lan. Q. Dang; Kien. T. Nguyen; Quang. K. Nguyen; Phuong. T. Dang; Hoa. T. K. Tran; Quang. T. Duong; Tuyen. V. Nguyen; Gun. D. Lee
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Recognizing water-based activities in the home through infrastructure-mediated sensing
err2012-09-05
err0
errOAAI
errEdison Thomaz; Vinay Bettadapura; Gabriel Reyes; Megha Sandesh; Grant Schindler; Thomas Plötz; Gregory D. Abowd; Irfan Essa
errShare
errSave
researcher View more