.png){kind=icon}
Return
RENDA: Resource and Network Aware Data Placement Algorithm for Periodic Workloads in Cloud
.png){kind=icon}
PRE
AI
DOI：10.1109/TPDS.2021.3080582.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
The Hadoop enabled cloud platforms are gradually becoming preferred computational environment to execute scientific big data workloads in a periodic manner. However, it is observed that the default data placement approach of such cloud platforms is not the efficient one and often ends up with significant data transfer overhead leading to degradation of the overall job completion time. In this article, a Resource and Network-aware Data Placement Algorithm (RENDA) is proposed to reduce the non-local executions and thereby reduce the overall job completion time for periodic workloads in the cloud environment. The entire job execution is modeled as a two-stage execution characterized as data distribution and data processing. The RENDA reduces the time of the stages as mentioned above by estimating the heterogeneous performance of the nodes on a real-time basis followed by careful allocation of data in several installments to participating nodes. The experimental results show that the proposed RENDA algorithm consistently outperforms over the recent state-of-the-art alternatives with as much as 28 percent reduction in data transfer overhead leading to 16 percent reduction in average job completion time with 27 percent average speedup on average job execution.
Keywords:
Cloud computing
Data models
Distributed databases
Data centers
Task analysis
Data transfer
Switches
MapReduce
cloud computing
data placement
periodic workloads
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
6
Papers:
5.2K
Citations:
1.1W
Organization
Cited Papers
ShareSaveShareSaveShareSaveShareSaveRecovery of Terephthalic Acid by employing magnetic nanoparticles as a solid support.png)
Polímeros
OAAI
PolímerosIF0
OAAIShareSaveShareSaveShareSaveShareSave
View more