返回
Random feature weights for decision tree ensemble construction
DOI:10.1016/j.inffus.2010.11.004.png)
摘要
En 中文
This paper proposes a method for constructing ensembles of decision trees, random feature weights (RFW). The method is similar to Random Forest, they are methods that introduce randomness in the construction method of the decision trees. In Random Forest only a random subset of attributes are considered for each node, but RFW considers all of them. The source of randomness is a weight associated with each attribute. All the nodes in a tree use the same set of random weights but different from the set of weights in other trees. So, the importance given to the attributes will be different in each tree and that will differentiate their construction. The method is compared to Bagging, Random Forest, Random-Subspaces, AdaBoost and MultiBoost, obtaining favourable results for the proposed method, especially when using noisy data sets. RFW can be combined with these methods. Generally, the combination of RFW with other method produces better results than the combined methods. Kappa-error diagrams and Kappa-error movement diagrams are used to analyse the relationship between the accuracies of the base classifiers and their diversity. (C) 2010 Elsevier B.V. All rights reserved.
Keyword:
Classifier ensembles
Bagging
Random-Subspaces
Boosting
Random Forests
Decision trees
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
15.5
论文数:
4.2K
被引数:
2.7W
机构
引用论文
Adaptive Impedance Control to Enhance Human Skill on a Haptic Interface System自适应阻抗控制以增强触觉接口系统上的人类技能
An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting, and randomization
MACHINE LEARNING
IF2.9
Effect of Temperature and Cationic Chain Length on the Physical Properties of Ammonium Nitrate-Based Protic Ionic Liquids温度和阳离子链长对硝酸铵基质子型离子液体物理性质的影响
Researchers' roles in knowledge co-production: experience from sustainability research in Kenya, Switzerland, Bolivia and Nepal研究人员在知识联合生产中的作用: 肯尼亚,瑞士,玻利维亚和尼泊尔的可持续性研究经验
A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting在线学习的决策理论概括及其在Boosting中的应用


