arrow
返回

A New Data Layout Scheme for Energy-Efficient MapReduce Processing Tasks

delete2018-02-26
delete5
PRE
AI
T
Tien Van Do
C
Csaba Rotter *
D
Dosam Hwang
DOI:10.1007/s10723-018-9433-7delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Yet Another Resource Negotiator (YARN) is a framework to manage and allocate resource requests from applications that process big data stored in HDFS. However, dynamic power management methods are not efficient when YARN manage applications to process big data stored in the default data layout of HDFS. In this paper, we propose a new data layout scheme that can be implemented for HDFS. A comparison between our proposal and the existing HDFS data layout scheme shows that the new data layout algorithm significantly reduces the energy consumption at the slight expense of the mean response time of jobs.
Keyword:
Hadoop
Layout
Big data processing
Data locality
Dynamic power management
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Journal of Grid Computing 封面图
Journal of Grid Computing
IF:
2.9
论文数:
761
被引数:
1.2K

机构

B
budapest university of technology & economics
学者数:
5.7K
论文数: 5.1K
被引数: 1
Y
Yeungnam University
学者数:
1.0W
论文数: 1.3W
被引数: 1.4W
T
Ton Duc Thang University
学者数:
3.4K
论文数: 4.8K
被引数: 6.6K
学者 查看更多机构
引用论文

引用论文

Reinforcing effects of brain microinjections of morphine revealed by conditioned place preference
err1982-07-01
err0
PREAI
errDerek Van Der Kooy; Ronald F. Mucha; Martha O'Shaughnessy; Peter Bucenieks
err分享
err收藏
err分享
err收藏
err分享
err收藏
Modulo Based Data Placement Algorithm for Energy Consumption Optimization of MapReduce System
err2016-06-25
err15
errOAAI
errSong, Jie; He, HongYan; Wang, Zhi; Yu, Ge; Pierson, Jean-Marc
err分享
err收藏
Metabolic responses of the isopod Porcellionides pruinosus to nickel exposure assessed by 1H NMR metabolomics
err2016-03-01
err0
errOAAI
errNuno G.C. Ferreira; Raquel Saborano; Rui Morgado; Diogo N. Cardoso; Cláudia M. Rocha; Amadeu M.V.M. Soares; Susana Loureiro; Iola F. Duarte
err分享
err收藏
学者 查看更多内容