arrow
Return

Stable feature selection using copula based mutual information

delete2021-04-01
delete37
PRE
AI
S
Snehalika Lall
S
Sinha Debajyoti
A
Abhik Ghosh *
D
Debarka Sengupta *
S
Sanghamitra Bandyopadhyay *
DOI:10.1016/j.patcog.2020.107697delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Feature selection is a key step in many machine learning tasks. A majority of the existing methods of feature selection address the problem by devising some scoring function while treating the features independently, thereby overlooking their interdependencies. We leverage the scale invariance property of copula to construct a greedy, supervised feature selection algorithm that maximizes the feature relevance while minimizing the redundant information content. Multivariate copula is used in the proposed copula Based Feature Selection (CBFS) to discover the dependence structure between features. The incorporation of copula-based multivariate dependency in the formulation of mutual information helps avoid averaging over multiple instances of bivariate dependencies, thus eliminating the average estimation error introduced when bivariate dependency is used between a pair of feature variables. Under a controlled setting, our algorithm outperformed the existing best practice methods in warding off the noise in data. On several real and synthetic datasets, the proposed algorithm performed competitively in maximizing classification accuracy. CBFS also outperforms the other methods in terms of its noise tolerance property. (c) 2020 Elsevier Ltd. All rights reserved.
Keywords:
Copula
Feature selection
Mutual information
Stability
Classification accuracy
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

I
indian statistical institute kolkata
Scholars:
761
Papers: 823
Citations: 1
I
Indian Statistical Institute
Scholars:
1.7K
Papers: 1.8K
Citations: 1.2K
C
chu de nantes
Scholars:
6.1K
Papers: 4.5K
Citations: 7
researcher View more organizations
Cited Papers

Cited Papers

Epidemiology of Pediatric Fractures Presenting to Emergency Departments in the United States
err2016-06-01
err0
PREAI
errSameer M. Naranje; Richard A. Erali; William C. Warner; Jeffrey R. Sawyer; Derek M. Kelly
errShare
errSave
Big data in healthcare: management, analysis and future prospects
err2019-06-19
err633
errOAAI
errDash, Sabyasachi; Shakyawar, Sushil Kumar; Sharma, Mohit; Kaushik, Sandeep
errShare
errSave
<title>Miniature fiber optic ultrasonic probe</title>
err1996-10-25
err0
errOAAI
errDavid J. Webb; J. Surowiec; M. Sweeney; David A. Jackson; L. R. Gavrilov; J. W. Hand; Lin Zhang; Ian Bennion
errShare
errSave
Association between mobility patterns and COVID-19 transmission in the USA: a mathematical modelling study
err2020-11-01
err548
errOAAI
errBadr, Hamada S.; Du, Hongru; Marshall, Maximilian; Dong, Ensheng; Squire, Marietta M.; Gardner, Lauren M.
errShare
errSave
Simultaneous feature selection and discretization based on mutual information
err2019-07-01
err91
PREAI
errSharmin, Sadia; Shoyaib, Mohammad; Ali, Amin Ahsan; Khan, Muhammad Asif Hossain; Chae, Oksam
errShare
errSave
Feature selection with dynamic mutual information
err2009-07-01
err301
PREAI
errLiu, Huawen; Sun, Jigui; Liu, Lei; Zhang, Huijie
errShare
errSave
researcher View more