.png){kind=icon}
.png){kind=icon}
Return
A New Data Layout Scheme for Energy-Efficient MapReduce Processing Tasks
.png){kind=icon}
PRE
AI
DOI：10.1007/s10723-018-9433-7.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Yet Another Resource Negotiator (YARN) is a framework to manage and allocate resource requests from applications that process big data stored in HDFS. However, dynamic power management methods are not efficient when YARN manage applications to process big data stored in the default data layout of HDFS. In this paper, we propose a new data layout scheme that can be implemented for HDFS. A comparison between our proposal and the existing HDFS data layout scheme shows that the new data layout algorithm significantly reduces the energy consumption at the slight expense of the mean response time of jobs.
Keywords:
Hadoop
Layout
Big data processing
Data locality
Dynamic power management
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
2.9
Papers:
759
Citations:
1.2K
Organization
View more organizations