arrow
Return

A Bootstrap Based Neyman-Pearson Test for Identifying Variable Importance

delete2015-04-01
delete25
delete
OA
AI
G
Gregory Ditzler *
R
Robi Polikar
G
Gail Rosen
DOI:10.1109/TNNLS.2014.2320415delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Selection of most informative features that leads to a small loss on future data are arguably one of the most important steps in classification, data analysis and model selection. Several feature selection (FS) algorithms are available; however, due to noise present in any data set, FS algorithms are typically accompanied by an appropriate cross-validation scheme. In this brief, we propose a statistical hypothesis test derived from the Neyman-Pearson lemma for determining if a feature is statistically relevant. The proposed approach can be applied as a wrapper to any FS algorithm, regardless of the FS criteria used by that algorithm, to determine whether a feature belongs in the relevant set. Perhaps more importantly, this procedure efficiently determines the number of relevant features given an initial starting point. We provide freely available software implementations of the proposed methodology.
Keywords:
Feature selection (FS)
Neyman-Pearson
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.5K
Citations:
7.2W

Organization

D
Drexel University
Scholars:
1.3W
Papers: 1.1W
Citations: 2.2W
R
Rowan University
Scholars:
3.5K
Papers: 2.6K
Citations: 2.2K