.png){kind=icon}
返回
PP: Popularity-based Proactive Data Recovery for HDFS RAID systems
.png){kind=icon}
PRE
AI
DOI：10.1016/j.future.2017.03.032.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Clustered storage systems as HDFS have become a popular platform for handling Big Data, susceptible to failures and data recovery whenever a failure is detected. However, existing recovery schemes in HDFS are passive, which affects the processing efficiency of MapReduce jobs and degrades the performance of Hadoop storage systems. In order to address this problem, this paper proposes a novel scheme called PP (Popularity-based Proactive Data Recovery), that significantly boost the recovery efficiency of HDFS RAID systems. PP tracks the popular data and immediately recovers the missing popular data when a node fails in Hadoop system, which effect and variation on the performance of MapReduce jobs is minimal. The lightweight prototype implementation of PP and extensive experiments demonstrate that, compared with Hadoop's default locally-first scheduling and the degraded-first scheduling, PP significantly reduces the recovery time as well the execution time of MapReduce jobs concurrently. (C) 2017 Elsevier B.V. All rights reserved.
Keyword:
Hadoop
Popular data
Proactive Data Recovery
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
F
IF:
6.1
论文数:
6.9K
被引数:
2.3W
机构
引用论文
How has our knowledge of dinosaur diversity through geologic time changed through research history?.png)
PeerJ
OAAI
PeerJIF0
OAAI分享收藏
查看更多内容