arrow
Return

Accelerating MapReduce framework on multi-GPU systems

delete2013-05-30
delete15
PRE
AI
H
Hai Jiang
陈
陈宜 (Yi Chen)
Z
Zhi Qiao
K
Kuan‐Ching Li *
W
Wonwoo Ro
J
Jean‐Luc Gaudiot
DOI:10.1007/s10586-013-0276-5delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Graphics processors evolve rapidly and promise to support power-efficient, cost, differentiated price-performance, and scalable high performance computing. MapReduce is a well-known distributed programming model to ease the development of applications for large-scale data processing on a large number of commodity CPUs. When compared to CPUs, GPUs are an order of magnitude faster in terms of computation power and memory bandwidth, but they are harder to program. Although several studies have implemented the MapReduce model on GPUs, most of them are based on the single GPU model and bounded by a GPU memory with inefficient atomic operations. This paper focuses on the development of MGMR, a standalone MapReduce system that utilizes multiple GPUs to manage large-scale data processing beyond the GPU memory limitation, and also to eliminate serial atomic operations. Experimental results have demonstrated the effectiveness of MGMR in handling large data sets.
Keywords:
GPU
MapReduce
Large scale data processing
Multi-GPUs

Journal

C
Cluster Computing-The Journal of Networks Software Tools and Applications
IF:
4.1
Papers:
5.0K
Citations:
7.5K

Organization

P
providence university - taiwan
Scholars:
842
Papers: 1.0K
Citations: 0
University of California System cover
University of California System
Scholars:
37.5W
Papers: 33.7W
Citations: 6.6K
Arkansas State University cover
Arkansas State University
Scholars:
857
Papers: 640
Citations: 590
Y
Yonsei University
Scholars:
4.8W
Papers: 4.6W
Citations: 5.2W
researcher View more organizations
Cited Papers

Cited Papers

Cellulose Derivatives Used as Chiral Stationary Phases in Capillary Gas Chromatography
err2006-01-01
err0
PREAI
errLi‐Ming Yuan; Yan Zhou; Yu‐Hai Zhang; Min Zi; Yin‐Xia Chang; Zhi‐Gang Xu,; Chao‐Xing Ren
errShare
errSave
Mapreduce: Simplified data processing on large clusters
err2008-01-01
err3.0K
errOAAI
errDean, Jeffrey; Ghemawat, Sanjay
errShare
errSave
no more