返回
Feature selection based on probability and mathematical expectation
DOI:10.1007/s13042-023-01920-8.png)
摘要
En 中文
Many kinds of information entropy are employed for feature selection, but they lack corresponding probabilities to interpret; Despite many statistical indicators utilized in feature selection, neither probability nor mathematical expectation was applied to perform feature selection directly. To address such two problems, this article redefines three kinds of probabilities and their corresponding mathematical expectations from the perspective of granular computing and investigates their properties. These novel probabilities and mathematical expectations extend the meanings of classical probability and mathematical expectation and provide statistical interpretation for their corresponding information entropy, and then, attribute reducts based on probabilities and mathematical expectations are defined, which are proved to be equivalent to those based on their corresponding information entropy. A framework of feature selection algorithms based on probabilities and mathematical expectations (ARME) is designed after the presentation of their properties. Moreover, a novel definition form for feature selection is proposed, and another feature selection algorithm based on the mathematical expectation of conditional probability (ARMEC) is designed to reduce negative features on classification. Theoretical analysis and experimental results show that probabilities and mathematical expectations have super efficiency than their corresponding information entropy when they are considered as criteria of feature selection. Therefore, the novel method has the advantage over many state-of-the-art algorithms.
Keyword:
Granular computing
Rough sets
Feature selection
Probability
Mathematical expectation
期刊
IF:
2.7
论文数:
3.2K
被引数:
5.6K
机构
引用论文
An Emerging Fuzzy Feature Selection Method Using Composite Entropy-Based Uncertainty Measure and Data Distribution一种新兴的基于复合熵的不确定性度量和数据分布的模糊特征选择方法
Late gadolinium enhancement on cardiac magnetic resonance combined with 123I- metaiodobenzylguanidine scintigraphy strongly predicts long-term clinical outcome in patients with dilated cardiomyopathy
PLOS ONE
IF0
A novel multi-objective forest optimization algorithm for wrapper feature selection一种新的包装器特征选择的多目标森林优化算法
Dynamic updating approximations of local generalized multigranulation neighborhood rough set局部广义多粒度邻域粗糙集的动态更新逼近
APPLIED INTELLIGENCE
IF3.5

