arrow
Return

A parameterless feature ranking algorithm based on MI

delete2008-03-01
delete15
PRE
AI
J
Jinjie Huang *
Y
Yunze Cai
徐小明 cover
徐小明 (Xiao‐Ming Xu)
DOI:10.1016/j.neucom.2007.04.012delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
A parameterless feature ranking approach is presented for feature selection in the pattern classification task. Compared with Battiti's mutual information feature selection (MIFS) and Kwak and Choi's MIFS-U methods, the proposed method derives an estimation of the conditional M I between the candidate feature f(i) and the output class C given the subset of selected features S, i.e. I(C;fi vertical bar S), without any parameters like beta in M IFS and M IFS-U methods to be preset. Thus, the intractable problem can be avoided completely, which is how to choose an appropriate value for beta to achieve the tradeoff between the relevance to the output classes and the redundancy with the already-selected features. Furthermore, a modified greedy feature selection algorithm called the second order MI feature selection approach (SOMIFS) is proposed. Experimental results demonstrate the superiority of SOMIFS in terms of both synthetic and benchmark data sets. (c) 2007 Elsevier B.V. All rights reserved.
Keywords:
FEATURE-SELECTION SCHEME
FLOATING SEARCH METHODS
INPUT FEATURE-SELECTION
MUTUAL INFORMATION
NEURAL-NETWORK
CLASSIFICATION
BRANCH
ERROR
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

S
shanghai jiao tong university
Scholars:
15.6W
Papers: 11.6W
Citations: 159
H
Harbin University
Scholars:
499
Papers: 421
Citations: 2.8K