.png){kind=icon}
返回
RENDA: Resource and Network Aware Data Placement Algorithm for Periodic Workloads in Cloud
.png){kind=icon}
PRE
AI
DOI：10.1109/TPDS.2021.3080582.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The Hadoop enabled cloud platforms are gradually becoming preferred computational environment to execute scientific big data workloads in a periodic manner. However, it is observed that the default data placement approach of such cloud platforms is not the efficient one and often ends up with significant data transfer overhead leading to degradation of the overall job completion time. In this article, a Resource and Network-aware Data Placement Algorithm (RENDA) is proposed to reduce the non-local executions and thereby reduce the overall job completion time for periodic workloads in the cloud environment. The entire job execution is modeled as a two-stage execution characterized as data distribution and data processing. The RENDA reduces the time of the stages as mentioned above by estimating the heterogeneous performance of the nodes on a real-time basis followed by careful allocation of data in several installments to participating nodes. The experimental results show that the proposed RENDA algorithm consistently outperforms over the recent state-of-the-art alternatives with as much as 28 percent reduction in data transfer overhead leading to 16 percent reduction in average job completion time with 27 percent average speedup on average job execution.
Keyword:
Cloud computing
Data models
Distributed databases
Data centers
Task analysis
Data transfer
Switches
MapReduce
cloud computing
data placement
periodic workloads
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6
论文数:
5.2K
被引数:
1.1W
机构
引用论文
分享收藏Recovery of Terephthalic Acid by employing magnetic nanoparticles as a solid support.png)
Polímeros
OAAI
PolímerosIF0
OAAI分享收藏Diamond Sketch: Accurate Per-flow Measurement for Big Streaming DataDiamond Sketch: 大数据流的精确流量测量
PREAI
分享收藏
查看更多内容