arrow
Return

Apache Hama: An Emerging Bulk Synchronous Parallel Computing Framework for Big Data Applications

delete2016-01-01
delete25
delete
OA
AI
K
Kamran Siddique
Z
Zahid Akhtar
E
Edward J. Yoon
Y
Young‐Sik Jeong
D
Dipankar Dasgupta
Y
Yangwoo Kim *
DOI:10.1109/ACCESS.2016.2631549delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
In today's highly intertwined network society, the demand for big data processing frameworks is continuously growing. The widely adopted model to process big data is parallel and distributed computing. This paper documents the significant progress achieved in the field of distributed computing frameworks, particularly Apache Hama, a top level project under the Apache Software Foundation, based on bulk synchronous parallel processing. The comparative studies and empirical evaluations performed in this paper reveal Hama's potential and efficacy in big data applications. In particular, we present a benchmark evaluation of Hama's graph package and Apache Giraph using PageRank algorithm. The results show that the performance of Hama is better than Giraph in terms of scalability and computational speed. However, despite great progress, a number of challenging issues continue to inhibit the full potential of Hama to be used at large scale. This paper also describes these challenges, analyzes solutions proposed to overcome them, and highlights research opportunities.
Keywords:
Apache Hama
big data
BSP
bulk synchronous parallel
distributed computing
Giraph
Hadoop
MapReduce
Spark

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

D
Dongguk University
Scholars:
8.2K
Papers: 9.3K
Citations: 1.0W
I
institut national de la recherche scientifique (inrs)
Scholars:
2.8K
Papers: 2.7K
Citations: 2
U
university of quebec
Scholars:
2.0W
Papers: 1.9W
Citations: 19
U
university of quebec montreal
Scholars:
3.9K
Papers: 3.5K
Citations: 7
researcher View more organizations
Cited Papers

Cited Papers

HEADS-JOIN: Efficient Earth Mover's Distance Similarity Joins on Hadoop
err2016-06-01
err19
PREAI
errHuang, Jin; Zhang, Rui; Buyya, Rajkumar; Chen, Jian; Wu, Yongwei
errShare
errSave
A Genomewide Screen for Tolerance to Cationic Drugs Reveals Genes Important for Potassium Homeostasis in Saccharomyces cerevisiae
err2011-09-01
err0
errOAAI
errLina Barreto; David Canadell; Silvia Petrezsélyová; Clara Navarrete; Lydie Marešová; Jorge Peréz-Valle; Rito Herrera; Iván Olier; Jesús Giraldo; Hana Sychrová; Lynne Yenush; José Ramos; Joaquín Ariño
errShare
errSave
Toward Scalable Systems for Big Data Analytics: A Technology Tutorial
err2014-01-01
err726
errOAAI
errHu, Han; Wen, Yonggang; Chua, Tat-Seng; Li, Xuelong
errShare
errSave
The validity of subjective measures of body image disturbance
err2004-01-01
err0
PREAI
errJ.Scott Mizes; Michelle Heffner; James K. Madison; Paula Varnado-Sullivan
errShare
errSave
errShare
errSave
errShare
errSave
Big Data with Cloud Computing: an insight on the computing environment, MapReduce, and programming frameworks
err2014-09-29
err175
PREAI
errFernandez, Alberto; del Rio, Sara; Lopez, Victoria; Bawakid, Abdullah; del Jesus, Maria J.; Benitez, Jose M.; Herrera, Francisco
errShare
errSave
researcher View more