arrow
返回

MapReduce Scheduler by Characterizing Performance Interference

delete2016-10-01
delete5
PRE
AI
L
Lei Yang
Y
Yu Dai *
张斌 封面图
张斌 (Bin Zhang)
DOI:10.1109/CC.2016.7733049delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Recently, virtualization has become more and more important in the cloud computing to support efficient flexible resource provisioning. However, performance interference among virtual machines (VMs) has become a challenge which may affect the effectiveness of resource provisioning. In a virtual cluster which runs the MapReduce applications, the performance interference can also affect the performance of the Map and Reduce tasks and thus cause a performance degradation of the MapReduce job. Accordingly, this paper presents a MapReduce scheduling framework to mitigate this performance degradation caused by the performance interference. The framework includes a performance interference prediction module and an interference aware scheduling algorithm. To verify its effectiveness, we have done a set of experiments on a 24-node virtual MapReduce cluster. The experiments illustrate that the proposed framework can achieve a performance improvement in the virtualized environment compared with other MapReduce schedulers.
Keyword:
MapReduce
scheduler
performance interference
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

China Communications 封面图
China Communications
IF:
3.1
论文数:
1.9K
被引数:
5.1K

机构

N
northeastern university - china
学者数:
3.2W
论文数: 2.7W
被引数: 8.3K
引用论文

引用论文

暂无论文信息