.png){kind=icon}
返回
Rotation Forest for Data
.png){kind=icon}
OA
AI
DOI：10.1016/j.inffus.2021.03.007.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The Rotation Forest classifier is a successful ensemble method for a wide variety of data mining applications. However, the way in which Rotation Forest transforms the feature space through PCA, although powerful, penalizes training and prediction times, making it unfeasible for Big Data. In this paper, a MapReduce Rotation Forest and its implementation under the Spark framework are presented. The proposed MapReduce Rotation Forest behaves in the same way as the standard Rotation Forest, training the base classifiers on a rotated space, but using a functional implementation of the rotation that enables its execution in Big Data frameworks. Experimental results are obtained using different cloud-based cluster configurations. Bayesian tests are used to validate the method against two ensembles for Big Data: Random Forest and PCARDE classifiers. Our proposal incorporates the parallelization of both the PCA calculation and the tree training, providing a scalable solution that retains the performance of the original Rotation Forest and achieves a competitive execution time (in average, at training, more than 3 times faster than other PCA-based alternatives). In addition, extensive experimentation shows that by setting some parameters of the classifier (i.e., bootstrap sample size, number of trees, and number of rotations), the execution time is reduced with no significant loss of performance using a small ensemble.
Keyword:
Rotation Forest
Random Forest
Ensemble learning
Machine learning
Big Data
Spark
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
15.5
论文数:
4.2K
被引数:
2.7W
机构
引用论文
Democratic instance selection: A linear complexity instance selection algorithm based on classifier ensemble concepts民主实例选择: 基于分类器集成概念的线性复杂度实例选择算法OAAI
OAAI分享收藏Learning distributed discrete Bayesian Network Classifiers under MapReduce with Apache Spark使用Apache Spark在MapReduce下学习分布式离散贝叶斯网络分类器
PREAI
分享收藏kNN-IS: An Iterative Spark-based design of the k-Nearest Neighbors classifier for big dataKnn-is: 基于Spark的大数据k近邻分类器迭代设计OAAI
OAAI分享收藏分享收藏A Bayesian approach for comparing cross-validated algorithms on multiple data sets.png)
MACHINE LEARNINGOAAI
MACHINE LEARNINGIF2.9
OAAI分享收藏分享收藏
查看更多内容