arrow
Return

Mutual information based input feature selection for classification problems

delete2012-12-01
delete38
PRE
AI
S
Shuang Cang *
H
Hongnian Yu
DOI:10.1016/j.dss.2012.08.014delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The elimination process aims to reduce the size of the input feature set and at the same time to retain the class discriminatory information for classification problems. This paper investigates the approaches to solve classification problems of the feature selection and proposes a new feature selection algorithm using the mutual information (MI) concept in information theory for the classification problems. The proposed algorithm calculates the MI between the combinations of input features and the class instead of the MI between a single input feature and the class for both continuous-valued and discrete-valued features. Three experimental tests are conducted to evaluate the proposed algorithm. Comparison studies of the proposed algorithm with the previously published classification algorithms indicate that the proposed algorithm is robust, stable and efficient. (C) 2012 Elsevier B.V. All rights reserved.
Keywords:
Feature ranking
Optimal feature set
Mutual information
Classification

Journal

Decision Support Systems cover
Decision Support Systems
IF:
6.8
Papers:
3.8K
Citations:
1.5W

Organization

S
staffordshire university
Scholars:
797
Papers: 810
Citations: 2
B
Bournemouth University
Scholars:
2.7K
Papers: 3.0K
Citations: 3.5K
Cited Papers

Cited Papers

Particle robotics based on statistical mechanics of loosely coupled components
err2019-03-20
err0
PREAI
errShuguang Li; Richa Batra; David Brown; Hyun-Dong Chang; Nikhil Ranganathan; Chuck Hoberman; Daniela Rus; Hod Lipson
errShare
errSave
Society of Mind Project
err
IF0
err1988-08-01
err0
PREAI
errMarvin Minsky
errShare
errSave
Modeling wine preferences by data mining from physicochemical properties
err2009-11-01
err836
errOAAI
errCortez, Paulo; Cerdeira, Antonio; Almeida, Fernando; Matos, Telmo; Reis, Jose
errShare
errSave
Coil Coating
err
IF0
err2005-01-01
err0
PREAI
errBernd Meuthen; Almuth-Sigrun Jandel
errShare
errSave
researcher View more