Divergence-based feature selection for separate classes

Yishi Zhang

doi:10.1016/j.neucom.2012.06.036

Divergence-based feature selection for separate classes

2013-02-01

37

PRE

AI

DOI：10.1016/j.neucom.2012.06.036

Original

Original request for help

Save

Abstract

En 中文

Feature selection is one of the core issues in designing pattern recognition systems and has attracted considerable attention in the literature. Most of the feature selection methods in the literature only handle relevance and redundancy analysis from the point of view of the whole class, which neglects the relation of features and the separate classes. In this paper, we propose a novel feature selection framework to explicitly handle the relevance and redundancy analysis for each class label. Then we propose two simple and effective feature selection algorithms based on this framework and Kullback-Leibler divergence. An empirical study is conducted to evaluate the efficiency and effectiveness of our algorithms comparing with five representative feature selection algorithms. Empirical results show that our proposed algorithms are efficient and outperform the selected algorithms in most cases, and show the superiority of our proposed feature selection framework. (C) 2012 Elsevier B.V. All rights reserved.

Keywords:

Feature selection

Kullback-Leibler divergence

Separate classes

Relevance

Redundancy

Divergence-based feature selection for separate classes

Abstract

Journal

Organization