返回
Dependence-biased clustering for variable selection with random forests
DOI:10.1016/j.patcog.2019.106980.png)
摘要
En 中文
We introduce a method for selecting a small subset of informative, non-redundant predictors from a set of input variables, given an output variable. The core of this method is a novel measure of variable importance, which is an enhancement of the so-called conditional permutation importance (CPI). In CPI, the importance of an input variable is measured by the expected increase of a random forest (RF)'s prediction error when such variable is randomly permuted within certain groups of observations. While CPI obtains these groups from the stochastic recursive partitions that the RF carries out on the input space, our measure relies on a new approach that groups observations by means of a special form of clustering, which optimally leverages the structure of dependences existing between input variables. We show that our measure can be effectively used to recursively eliminate both unimportant and redundant input variables. Extensive experimental results illustrate the effectiveness of our method in comparison with many RF-based methods for variable selection. (C) 2019 Published by Elsevier Ltd.
Keyword:
Variable selection
Random forest
Permutation importance
Regression
Classification
Clustering
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
Surface Enrichment in Equimolar Mixtures of Non‐Functionalized and Functionalized Imidazolium‐Based Ionic Liquids
ChemPhysChem
IF0
Inducible expression of PTX3, a new member of the pentraxin family, in human mononuclear phagocytes
Blood
IF0

