返回
Stable feature selection using copula based mutual information
DOI:10.1016/j.patcog.2020.107697.png)
摘要
En 中文
Feature selection is a key step in many machine learning tasks. A majority of the existing methods of feature selection address the problem by devising some scoring function while treating the features independently, thereby overlooking their interdependencies. We leverage the scale invariance property of copula to construct a greedy, supervised feature selection algorithm that maximizes the feature relevance while minimizing the redundant information content. Multivariate copula is used in the proposed copula Based Feature Selection (CBFS) to discover the dependence structure between features. The incorporation of copula-based multivariate dependency in the formulation of mutual information helps avoid averaging over multiple instances of bivariate dependencies, thus eliminating the average estimation error introduced when bivariate dependency is used between a pair of feature variables. Under a controlled setting, our algorithm outperformed the existing best practice methods in warding off the noise in data. On several real and synthetic datasets, the proposed algorithm performed competitively in maximizing classification accuracy. CBFS also outperforms the other methods in terms of its noise tolerance property. (c) 2020 Elsevier Ltd. All rights reserved.
Keyword:
Copula
Feature selection
Mutual information
Stability
Classification accuracy
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
Online and offline handwritten Chinese character recognition: A comprehensive study and new benchmark在线和离线手写汉字识别: 综合研究和新基准
PATTERN RECOGNITION
IF7.6
Big data in healthcare: management, analysis and future prospects医疗大数据: 管理、分析与未来展望
JOURNAL OF BIG DATA
IF6.4
Simultaneous feature selection and discretization based on mutual information基于互信息的同时特征选择和离散化
PATTERN RECOGNITION
IF7.6

