arrow
返回

Makespan minimization for MapReduce systems with different servers

delete2017-02-01
delete12
PRE
AI
Y
Yiwei Jiang *
朱
朱妤晴 (Yuqing Zhu)
W
Weili Wu
李德英 封面图
李德英 (Deying Li)
DOI:10.1016/j.future.2016.07.012delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this paper we study MapReduce scheduling on n parallel machines (servers) with different speeds v(1) >= v(2) >= ... >= v(n). Each job contains two kinds of tasks: map tasks and reduce tasks. The job's reduce tasks can only be processed after finishing all its map tasks. We assume that the map tasks are parallelized, i.e., it can be arbitrarily split and parts of the same task can be processed on different machines in parallel, while the reduce tasks are non-parallelizable. We consider both the offline and online scheduling problems. On offline version, if the reduce tasks are non-preemptive, we design an approximation algorithm whose worst case ratio is at most max{1 + Delta/2 - 1/n, Delta}, where Delta = v(1)/v(n) is the ratio of the fastest speed to the slowest speed. If the reduce tasks are preemptive, we provide an approximation algorithm with worst case ratio of 2. On online version where jobs arriving over time, we design two heuristics for non-preemptive and preemptive reduce tasks respectively. In experiment, we verify the advantage of our algorithms comparing with the state-of-the-art. (C) 2016 Elsevier B.V. All rights reserved.
Keyword:
MapReduce
Scheduling algorithm
Worst-case ratio
Big data
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

F
Future Generation Computer Systems-The International Journal of eScience
IF:
6.1
论文数:
6.8K
被引数:
2.3W

机构

California State University System 封面图
California State University System
学者数:
2.8W
论文数: 2.4W
被引数: 457
Z
Zhejiang Sci-Tech University
学者数:
1.7W
论文数: 1.0W
被引数: 1.3W
C
California State University Los Angeles
学者数:
1.0K
论文数: 718
被引数: 1.6K
U
university of texas system
学者数:
18.5W
论文数: 15.6W
被引数: 210
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Ghanaian cocoa varieties and swollen shoot virus
err1988-08-01
err0
PREAI
errJ.M. Thresh; G.K. Owusu; A. Boamah; G. Lockwood
err分享
err收藏
Evaluation of Diverse Convolutional Neural Networks and Training Strategies for Wheat Leaf Disease Identification with Field-Acquired Photographs
err2022-07-18
err0
errOAAI
errJiale Jiang; Haiyan Liu; Chen Zhao; Can He; Jifeng Ma; Tao Cheng; Yan Zhu; Weixing Cao; Xia Yao
err分享
err收藏
Age-related gene expression signatures from limb skeletal muscles and the diaphragm in mice and rats reveal common and species-specific changes
err2023-07-12
err0
errOAAI
errTea Shavlakadze; Kun Xiong; Shawn Mishra; Corissa McEwen; Abhilash Gadi; Matthew Wakai; Hunter Salmon; Michael J. Stec; Nicole Negron; Min Ni; Yi Wei; Gurinder S. Atwal; Yu Bai; David J. Glass
err分享
err收藏
A Facile and Rapid Fabrication of Multifunctional Color-Tuned Titanium
err2020-11-23
err0
errOAAI
errJihun Choi; Soyeon Park; Sangmin Jeon; Changyong Yim
err分享
err收藏
Scheduling algorithm based on prefetching in MapReduce clusters
err2016-01-01
err23
errOAAI
errSun, Mingming; Zhuang, Hang; Li, Changlong; Lu, Kun; Zhou, Xuehai
err分享
err收藏
Classification Framework of MapReduce Scheduling AlgorithmsMapReduce调度算法的分类框架
err2015-04-16
err49
PREAI
errTiwari, Nidhi; Sarkar, Santonu; Bellur, Umesh; Indrawan, Maria
err分享
err收藏
没有更多内容