.png){kind=icon}
返回
Exploiting Pipelined Encoding Process to Boost Erasure-Coded Data Archival
.png){kind=icon}
PRE
AI
DOI：10.1109/TPDS.2014.2366113.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
This paper addresses an issue of erasure-coded data archival, where (k + r,k) erasure codes are employed to archive rarely accessed replicas. The traditional synchronous encoding process neither leverages the existence of replicas, nor handles encoding operations in a decentralized manner. To overcome these drawbacks, we exploit pipelined encoding processes to boost the data archival performance on storage clusters. First, we propose two data layouts called [D + P](cd) and [3X](cd) by applying a chained-declustering mechanism to both Mirrored RAID-5 and triplication redundancy groups. Second, in light of the [D + P](cd) and [3X](cd) layouts, we design two archiving schemes named DP and 3X, which exhibit the following three salient features: (i) exploiting data locality-two or three local blocks are read by each involved node for encoding; (ii) decentralized computation load-encoding operations are distributed among k nodes; and (iii) parallel archival processing-two or three encoding pipelines are simultaneously deployed to generate parity blocks. We implement both the DP and 3X schemes and three existing solutions (i.e., SynE, DE, and RapidRAID) in a real-world storage cluster. Experimental results show that our archival schemes outperform the other three solutions in terms of archiving time by a factor of at least 3.41 in a nine-node storage cluster. The experiments strongly indicate that the performance bottleneck of SynE lies in its block-receiving stage; it is disk I/O rather than network traffic that dominates archiving time for both the DE and RapidRAID schemes.
Keyword:
Erasure-coded storage cluster
data archival
pipelined encoding
power efficiency
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6
论文数:
5.2K
被引数:
1.1W
机构
引用论文
How has our knowledge of dinosaur diversity through geologic time changed through research history?.png)
PeerJ
OAAI
PeerJIF0
OAAI分享收藏分享收藏分享收藏Relevance of iodine intake as a reputed predisposing factor for thyroid cancer碘摄入量与甲状腺癌的易感因素的相关性
OAAI
OAAI分享收藏
查看更多内容