.png){kind=icon}
返回
A Systematic Approach for Variable Selection With Random Forests: Achieving Stable Variable Importance Values
.png){kind=icon}
OA
AI
DOI：10.1109/LGRS.2017.2745049.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Random Forests variable importance measures are often used to rank variables by their relevance to a classification problem and subsequently reduce the number of model inputs in high-dimensional data sets, thus increasing computational efficiency. However, as a result of the way that training data and predictor variables are randomly selected for use in constructing each tree and splitting each node, it is also well known that if too few trees are generated, variable importance rankings tend to differ between model runs. In this letter, we characterize the effect of the number of trees (ntree) and class separability on the stability of variable importance rankings and develop a systematic approach to define the number of model runs and/or trees required to achieve stability in variable importance measures. Results demonstrate that both a large ntree for a single model run, or averaged values across multiple model runs with fewer trees, are sufficient for achieving stable mean importance values. While the latter is far more computationally efficient, both the methods tend to lead to the same ranking of variables. Moreover, the optimal number of model runs differs depending on the separability of classes. Recommendations are made to users regarding how to determine the number of model runs and/or trees that are required to achieve stable variable importance rankings.
Keyword:
Mean decrease in accuracy (MDA)
mean decrease in Gini (MDG) index
random forest
variable reduction
期刊
IF:
16.4
论文数:
1.0W
被引数:
5.1K
机构
引用论文
A numerical solution of the multidimensional solidification (or melting) problem多维凝固 (或熔化) 问题的数值解
.png){kind=icon}
PREAI
分享收藏分享收藏
查看更多内容