arrow
Return

Stable feature selection using copula based mutual information

delete2021-04-01
delete37
PRE
AI
S
Snehalika Lall
S
Sinha Debajyoti
A
Abhik Ghosh *
D
Debarka Sengupta *
S
Sanghamitra Bandyopadhyay *
DOI:10.1016/j.patcog.2020.107697delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Feature selection is a key step in many machine learning tasks. A majority of the existing methods of feature selection address the problem by devising some scoring function while treating the features independently, thereby overlooking their interdependencies. We leverage the scale invariance property of copula to construct a greedy, supervised feature selection algorithm that maximizes the feature relevance while minimizing the redundant information content. Multivariate copula is used in the proposed copula Based Feature Selection (CBFS) to discover the dependence structure between features. The incorporation of copula-based multivariate dependency in the formulation of mutual information helps avoid averaging over multiple instances of bivariate dependencies, thus eliminating the average estimation error introduced when bivariate dependency is used between a pair of feature variables. Under a controlled setting, our algorithm outperformed the existing best practice methods in warding off the noise in data. On several real and synthetic datasets, the proposed algorithm performed competitively in maximizing classification accuracy. CBFS also outperforms the other methods in terms of its noise tolerance property. (c) 2020 Elsevier Ltd. All rights reserved.
Keywords:
Copula
Feature selection
Mutual information
Stability
Classification accuracy
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

I
indian statistical institute kolkata
Scholars:
751
Papers: 814
Citations: 1
C
chu de nantes
Scholars:
6.1K
Papers: 4.5K
Citations: 7
I
Indian Statistical Institute
Scholars:
1.7K
Papers: 1.8K
Citations: 1.2K
researcher View more organizations