.png){kind=icon}
Return
Dependence-biased clustering for variable selection with random forests
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patcog.2019.106980.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
We introduce a method for selecting a small subset of informative, non-redundant predictors from a set of input variables, given an output variable. The core of this method is a novel measure of variable importance, which is an enhancement of the so-called conditional permutation importance (CPI). In CPI, the importance of an input variable is measured by the expected increase of a random forest (RF)'s prediction error when such variable is randomly permuted within certain groups of observations. While CPI obtains these groups from the stochastic recursive partitions that the RF carries out on the input space, our measure relies on a new approach that groups observations by means of a special form of clustering, which optimally leverages the structure of dependences existing between input variables. We show that our measure can be effectively used to recursively eliminate both unimportant and redundant input variables. Extensive experimental results illustrate the effectiveness of our method in comparison with many RF-based methods for variable selection. (C) 2019 Published by Elsevier Ltd.
Keywords:
Variable selection
Random forest
Permutation importance
Regression
Classification
Clustering
Journal
IF:
7.6
Papers:
1.4W
Citations:
4.5W
Organization
Cited Papers
Surface Enrichment in Equimolar Mixtures of Non‐Functionalized and Functionalized Imidazolium‐Based Ionic Liquids.png)
ChemPhysChem
OAAI
ChemPhysChemIF0
OAAIShareSaveShareSaveShareSaveInducible expression of PTX3, a new member of the pentraxin family, in human mononuclear phagocytesBlood
OAAI
BloodIF0
OAAIShareSaveShareSaveShareSave
View more