返回
Inferring statistically significant features from random forests
DOI:10.1016/j.neucom.2014.07.067.png)
摘要
En 中文
Embedded feature selection can be performed by analyzing the variables used in a Random Forest. Such a multivariate selection takes into account the interactions between variables but is not straightforward to interpret in a statistical sense. We propose a statistical procedure to measure variable importance that tests if variables are significantly useful in combination with others in a forest. We show experimentally that this new importance index correctly identifies relevant variables. The top of the variable ranking is largely correlated with Breiman's importance index based on a permutation test. Our measure has the additional benefit to produce p-values from the forest voting process. Such p-values offer a very natural way to decide which features are significantly relevant while controlling the false discovery rate. Practical experiments are conducted on synthetic and real data including low and high-dimensional datasets for binary or multi-class problems. Results show that the proposed technique is effective and outperforms recent alternatives by reducing the computational complexity of the selection process by an order of magnitude while keeping similar performances. (C) 2014 Elsevier B.V. All rights reserved.
Keyword:
Feature selection
Tree ensembles
Significance tests
High-dimensional data analysis
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
Diffuse large B-cell lymphoma outcome prediction by gene-expression profiling and supervised machine learning
NATURE MEDICINE
IF50
Evaluating the Potential of Phytochemicals as Natural Substitute for Synthetic Antioxidant: A Review
Rapid Nuclear Factor κB Activation and Cytokine and Heme Oxygenase-1 Gene Expression in Edematous White Matter After Porcine Intracerebral Hemorrhage
Stroke
IF0
MEMS based multi-band Energy Harvesting for Wireless Sensor Network applications基于MEMS的多频带能量收集在无线传感器网络中的应用

