arrow
返回

Inferring statistically significant features from random forests

delete2015-02-01
delete14
delete
OA
AI
J
Jérôme Paul *
P
Pierre Dupont
DOI:10.1016/j.neucom.2014.07.067delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Embedded feature selection can be performed by analyzing the variables used in a Random Forest. Such a multivariate selection takes into account the interactions between variables but is not straightforward to interpret in a statistical sense. We propose a statistical procedure to measure variable importance that tests if variables are significantly useful in combination with others in a forest. We show experimentally that this new importance index correctly identifies relevant variables. The top of the variable ranking is largely correlated with Breiman's importance index based on a permutation test. Our measure has the additional benefit to produce p-values from the forest voting process. Such p-values offer a very natural way to decide which features are significantly relevant while controlling the false discovery rate. Practical experiments are conducted on synthetic and real data including low and high-dimensional datasets for binary or multi-class problems. Results show that the proposed technique is effective and outperforms recent alternatives by reducing the computational complexity of the selection process by an order of magnitude while keeping similar performances. (C) 2014 Elsevier B.V. All rights reserved.
Keyword:
Feature selection
Tree ensembles
Significance tests
High-dimensional data analysis
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

U
universite catholique louvain
学者数:
2.0W
论文数: 1.7W
被引数: 21
引用论文

引用论文

Diffuse large B-cell lymphoma outcome prediction by gene-expression profiling and supervised machine learning
err2002-01-01
err2.1K
PREAI
errShipp, MA; Ross, KN; Tamayo, P; Weng, AP; Kutok, JL; Aguiar, RCT; Gaasenbeek, M; Angelo, M; Reich, M; Pinkus, GS; Ray, TS; Koval, MA; Last, KW; Norton, A; Lister, TA; Mesirov, J; Neuberg, DS; Lander, ES; Aster, JC; Golub, TR
err分享
err收藏
5GNOW: Challenging the LTE Design Paradigms of Orthogonality and Synchronicity
err2013-06-01
err0
errOAAI
errGerhard Wunder; Martin Kasparick; Stephan ten Brink; Frank Schaich; Thorsten Wild; Ivan Gaspar; Eckhard Ohlmer; Stefan Krone; Nicola Michailow; Ainoa Navarro; Gerhard Fettweis; Dimitri Ktenas; Vincent Berg; Marcin Dryjanski; Slawomir Pietrzyk; Bertalan Eged
err分享
err收藏
Quantum Electronic Stress: Density-Functional-Theory Formulation and Physical Manifestation
err2012-07-31
err0
errOAAI
errHao Hu; Miao Liu; Z. F. Wang; Junyi Zhu; Dangxin Wu; Hepeng Ding; Zheng Liu; Feng Liu
err分享
err收藏
Evaluating the Potential of Phytochemicals as Natural Substitute for Synthetic Antioxidant: A Review
err2022-01-25
err0
errOAAI
errMohammad Hossein Maleki; Milad Daneshniya; Zahra Latifi; Younes Pirouz Zarrin; Maral Behzadinia; Naghmeh Morakabati
err分享
err收藏
Rapid Nuclear Factor κB Activation and Cytokine and Heme Oxygenase-1 Gene Expression in Edematous White Matter After Porcine Intracerebral Hemorrhage
err2001-01-01
err0
errOAAI
errKenneth R Wagner; James Knight; Benjamin A Packard; Gabrielle M de Courten-Myers; Alan G Smulian; Joseph P Broderick
err分享
err收藏
Random forests随机森林
err2001-01-01
err3.1W
errOAAI
errBreiman, L
err分享
err收藏
学者 查看更多内容