返回
A New Data Layout Scheme for Energy-Efficient MapReduce Processing Tasks
DOI:10.1007/s10723-018-9433-7.png)
摘要
En 中文
Yet Another Resource Negotiator (YARN) is a framework to manage and allocate resource requests from applications that process big data stored in HDFS. However, dynamic power management methods are not efficient when YARN manage applications to process big data stored in the default data layout of HDFS. In this paper, we propose a new data layout scheme that can be implemented for HDFS. A comparison between our proposal and the existing HDFS data layout scheme shows that the new data layout algorithm significantly reduces the energy consumption at the slight expense of the mean response time of jobs.
Keyword:
Hadoop
Layout
Big data processing
Data locality
Dynamic power management
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
2.9
论文数:
761
被引数:
1.2K
机构
引用论文
Dynamic energy efficient data placement and cluster reconfiguration algorithm for MapReduce framework面向MapReduce框架的动态节能数据放置和集群重构算法

