arrow
Return

Scheduling divisible MapReduce computations

delete2011-03-01
delete57
PRE
AI
J
Joanna Berlińska
M
Maciej Drozdowski *
DOI:10.1016/j.jpdc.2010.12.004delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper we analyze MapReduce distributed computations as a divisible load scheduling problem. The two operations of mapping and reducing can be understood as two divisible applications with precedence constraints. A divisible load model of the computation, and two load partitioning algorithms are proposed. Performance limits of MapReduce computations are investigated. To our best knowledge this is the first time that processing applications with precedence constraints have been considered on the grounds of divisible load theory. (C) 2010 Elsevier Inc. All rights reserved.
Keywords:
Parallel processing
MapReduce
Scheduling
Divisible loads
Performance evaluation
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Journal of Parallel and Distributed Computing cover
Journal of Parallel and Distributed Computing
IF:
4
Papers:
3.8K
Citations:
4.8K

Organization

P
Poznan University of Technology
Scholars:
4.4K
Papers: 4.1K
Citations: 3
A
adam mickiewicz university
Scholars:
6.7K
Papers: 7.2K
Citations: 70