arrow
Return

Scalable and Parallel Boosting with MapReduce

delete2012-10-01
delete69
PRE
AI
P
Palit, Indranil *
C
Chandan K. Reddy
DOI:10.1109/TKDE.2011.208delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this era of data abundance, it has become critical to process large volumes of data at much faster rates than ever before. Boosting is a powerful predictive model that has been successfully used in many real-world applications. However, due to the inherent sequential nature, achieving scalability for boosting is nontrivial and demands the development of new parallelized versions which will allow them to efficiently handle large-scale data. In this paper, we propose two parallel boosting algorithms, ADABOOST.PL and LOGITBOOST.PL, which facilitate simultaneous participation of multiple computing nodes to construct a boosted ensemble classifier. The proposed algorithms are competitive to the corresponding serial versions in terms of the generalization performance. We achieve a significant speedup since our approach does not require individual computing nodes to communicate with each other for sharing their data. In addition, the proposed approach also allows for preserving privacy of computations in distributed environments. We used MapReduce framework to implement our algorithms and demonstrated the performance in terms of classification accuracy, speedup and scaleup using a wide variety of synthetic and real-world data sets.
Keywords:
Boosting
parallel algorithms
classification
distributed computing
MapReduce

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.9K
Citations:
3.2W

Organization

U
University of Notre Dame
Scholars:
1.2W
Papers: 1.1W
Citations: 1.7W
W
wayne state university
Scholars:
2.0W
Papers: 1.6W
Citations: 17
Cited Papers

Cited Papers

BioGRID: a general repository for interaction datasets
err2006-01-01
err3.3K
errOAAI
errStark, Chris; Breitkreutz, Bobby-Joe; Reguly, Teresa; Boucher, Lorrie; Breitkreutz, Ashton; Tyers, Mike
errShare
errSave
Characterization of polymer matrix and low melting point solder for anisotropic conductive film
err2008-02-01
err0
PREAI
errYong-Sung Eom; Ji-Won Baek; Jong-Tae Moon; Jae-Do Nam; Jong-Min Kim
errShare
errSave
Bagging predictors
err1996-08-01
err1.0W
PREAI
errBreiman, L
errShare
errSave
Systematic review of animal-based indicators to measure thermal, social, and immune-related stress in pigs
err2022-05-05
err0
errOAAI
errRaúl David Guevara; Jose J. Pastor; Xavier Manteca; Gemma Tedo; Pol Llonch
errShare
errSave
Evaluation of desialylation during 2-amino benzamide labeling of asparagine-linked oligosaccharides
err2014-08-01
err0
PREAI
errUdayananth Aich; Deanna C. Hurum; Lipika Basumallick; Srinivasa Rao; Chris Pohl; Jeffrey S. Rohrer; Sebastian Kandzia
errShare
errSave
errShare
errSave
Logistic regression, AdaBoost and Bregman distances
err2002-01-01
err426
errOAAI
errCollins, M; Schapire, RE; Singer, Y
errShare
errSave
researcher View more