.png){kind=icon}
返回
MEST: A Model-Driven Efficient Searching Approach for MapReduce Self-Tuning
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2017.2672675.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Hadoop is the most popular implementation framework of the MapReduce programming model, and it has a number of performance-critical configuration parameters. However, manually setting these parameters to their optimal values not only needs in-depth knowledge on Hadoop as well as the job itself, but also requires a large amount of time and efforts. Automatic approaches have therefore been proposed. Their usage, however, is still quite limited due to the intolerably long searching time. In this paper, we introduce MapreducE Self-Tuning (MEST), a framework that accelerates the searching process for the optimal configuration of a given Hadoop application. We have devised a novel mechanism by integrating the model trees algorithm with the genetic algorithm. As such, MEST significantly reduces the searching time by removing unnecessary profiling, modeling, and searching steps, which are mandatory for existing approaches. Our experiments using five benchmarks, each with two input data sets (DS1 and 2 x DS1) show that MEST improves the searching efficiency (SE) by factors of 1.37x and 2.18x on average respectively over the state-of-the-art approach.
Keyword:
MapReduce
Hadoop
self-tuning
model trees
genetic algorithm
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
.png){kind=icon}
NEUROD1 mutation in an Italian patient with maturity onset diabetes of the young 6: a case report
OAAI
OAAI分享收藏分享收藏
查看更多内容