arrow
返回

Dependence-biased clustering for variable selection with random forests

delete2019-12-01
delete11
PRE
AI
G
Gianluca Gazzola
M
Myong K. Jeong *
DOI:10.1016/j.patcog.2019.106980delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We introduce a method for selecting a small subset of informative, non-redundant predictors from a set of input variables, given an output variable. The core of this method is a novel measure of variable importance, which is an enhancement of the so-called conditional permutation importance (CPI). In CPI, the importance of an input variable is measured by the expected increase of a random forest (RF)'s prediction error when such variable is randomly permuted within certain groups of observations. While CPI obtains these groups from the stochastic recursive partitions that the RF carries out on the input space, our measure relies on a new approach that groups observations by means of a special form of clustering, which optimally leverages the structure of dependences existing between input variables. We show that our measure can be effectively used to recursively eliminate both unimportant and redundant input variables. Extensive experimental results illustrate the effectiveness of our method in comparison with many RF-based methods for variable selection. (C) 2019 Published by Elsevier Ltd.
Keyword:
Variable selection
Random forest
Permutation importance
Regression
Classification
Clustering
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

R
rutgers university system
学者数:
4.1W
论文数: 3.7W
被引数: 53
引用论文

引用论文

Surface Enrichment in Equimolar Mixtures of Non‐Functionalized and Functionalized Imidazolium‐Based Ionic Liquids
err2018-05-11
err0
errOAAI
errBettina S. J. Heller; Claudia Kolbeck; Inga Niedermaier; Sabine Dommer; Jürgen Schatz; Patricia Hunt; Florian Maier; Hans‐Peter Steinrück
err分享
err收藏
Inducible expression of PTX3, a new member of the pentraxin family, in human mononuclear phagocytes
err1994-11-15
err0
errOAAI
errVV Alles; B Bottazzi; G Peri; J Golay; M Introna; A Mantovani
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Class-specific mutual information variation for feature selection
err2018-07-01
err125
PREAI
errGao, Wanfu; Hu, Liang; Zhang, Ping
err分享
err收藏
Bacterial Distribution in the Lungs of Children with Protracted Bacterial Bronchitis
err2014-09-26
err0
errOAAI
errRavi Narang; Kelly Bakewell; Jane Peach; Sadie Clayton; Martin Samuels; John Alexander; Warren Lenney; Francis J. Gilchrist
err分享
err收藏
学者 查看更多内容