arrow
返回

Scalable and Parallel Boosting with MapReduce

delete2012-10-01
delete69
PRE
AI
P
Palit, Indranil *
C
Chandan K. Reddy
DOI:10.1109/TKDE.2011.208delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this era of data abundance, it has become critical to process large volumes of data at much faster rates than ever before. Boosting is a powerful predictive model that has been successfully used in many real-world applications. However, due to the inherent sequential nature, achieving scalability for boosting is nontrivial and demands the development of new parallelized versions which will allow them to efficiently handle large-scale data. In this paper, we propose two parallel boosting algorithms, ADABOOST.PL and LOGITBOOST.PL, which facilitate simultaneous participation of multiple computing nodes to construct a boosted ensemble classifier. The proposed algorithms are competitive to the corresponding serial versions in terms of the generalization performance. We achieve a significant speedup since our approach does not require individual computing nodes to communicate with each other for sharing their data. In addition, the proposed approach also allows for preserving privacy of computations in distributed environments. We used MapReduce framework to implement our algorithms and demonstrated the performance in terms of classification accuracy, speedup and scaleup using a wide variety of synthetic and real-world data sets.
Keyword:
Boosting
parallel algorithms
classification
distributed computing
MapReduce

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.8K
被引数:
3.2W

机构

U
University of Notre Dame
学者数:
1.2W
论文数: 1.1W
被引数: 1.7W
W
wayne state university
学者数:
2.0W
论文数: 1.6W
被引数: 17
引用论文

引用论文

BioGRID: a general repository for interaction datasetsBioGRID: 交互数据集的通用存储库
err2006-01-01
err3.3K
errOAAI
errStark, Chris; Breitkreutz, Bobby-Joe; Reguly, Teresa; Boucher, Lorrie; Breitkreutz, Ashton; Tyers, Mike
err分享
err收藏
Bagging predictorsBagging预测器
err1996-08-01
err1.0W
PREAI
errBreiman, L
err分享
err收藏
Systematic review of animal-based indicators to measure thermal, social, and immune-related stress in pigs
err2022-05-05
err0
errOAAI
errRaúl David Guevara; Jose J. Pastor; Xavier Manteca; Gemma Tedo; Pol Llonch
err分享
err收藏
Evaluation of desialylation during 2-amino benzamide labeling of asparagine-linked oligosaccharides
err2014-08-01
err0
PREAI
errUdayananth Aich; Deanna C. Hurum; Lipika Basumallick; Srinivasa Rao; Chris Pohl; Jeffrey S. Rohrer; Sebastian Kandzia
err分享
err收藏
err分享
err收藏
Logistic regression, AdaBoost and Bregman distances
err2002-01-01
err426
errOAAI
errCollins, M; Schapire, RE; Singer, Y
err分享
err收藏
学者 查看更多内容