Feature selection based on conditional mutual information: minimum conditional relevance and minimum conditional redundancy

doi:10.1007/s10489-018-1305-0

Feature selection based on conditional mutual information: minimum conditional relevance and minimum conditional redundancy

2018-10-09

46

PRE

AI

DOI：10.1007/s10489-018-1305-0

Original

Original request for help

Save

Abstract

En 中文

Feature selection is a process that selects some important features from original feature set. Many existing feature selection algorithms based on information theory concentrate on maximizing relevance and minimizing redundancy. In this paper, relevance and redundancy are extended to conditional relevance and conditional redundancy. Because of the natures of the two conditional relations, they tend to produce more accurate feature relations. A new frame integrating the two conditional relations is built in this paper and two new feature selection methods are proposed, which are Minimum Conditional Relevance-Minimum Conditional Redundancy (MCRMCR) and Minimum Conditional Relevance-Minimum Intra-Class Redundancy (MCRMICR) respectively. The proposed methods can select high class-relevance and low-redundancy features. Experimental results for twelve datasets verify the proposed methods perform better on feature selection and have high classification accuracy.

Keywords:

Feature selection

Mutual information

Conditional redundancy

Intra-class redundancy

Feature selection based on conditional mutual information: minimum conditional relevance and minimum conditional redundancy

Abstract

AI Summary

Journal

Organization