arrow
返回

Demand-Aware Erasure Coding for Distributed Storage Systems

delete2021-04-01
delete12
PRE
AI
J
Jun Li *
李葆春 封面图
李葆春 (Baochun Li)
DOI:10.1109/TCC.2018.2885306delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Distributed storage systems provide cloud storage services by storing data on commodity storage servers. Conventionally, data are protected against failures of such commodity servers by replication. Erasure coding consumes less storage overhead than replication to tolerate the same number of failures and thus has been replacing replication in many distributed storage systems. However, with erasure coding, the overhead of reconstructing data from failures also increases significantly. Under the ever-changing workload where data accesses can be highly skewed, it is challenging to deploy erasure coding with appropriate values of parameters to achieve a well trade-off between storage overhead and reconstruction overhead. In this paper, we propose Zebra, a framework that encodes data by their demand into multiple tiers that deploy erasure codes with different values of parameters. Zebra automatically determines the number of such tiers and dynamically assigns erasure codes with optimal values of parameters into corresponding tiers. With Zebra, a flexible trade-off between storage overhead and reconstruction overhead is achieved with multiple tiers. When demand changes, Zebra adjusts itself with a marginal amount of network transfer. We demonstrate that Zebra can work with two representative families of erasure codes in distributed storage systems, Reed-Solomon codes and local reconstruction codes.
Keyword:
Distributed storage system
demand skewness
erasure coding
reconstruction
storage overhead
Reed-Solomon code
local reconstruction code
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
IEEE Transactions on Cloud Computing
IF:
5
论文数:
1.8K
被引数:
4.3K

机构

State University System of Florida 封面图
State University System of Florida
学者数:
12.7W
论文数: 10.9W
被引数: 130
F
Florida International University
学者数:
7.4K
论文数: 5.9K
被引数: 1.1W
引用论文

引用论文

Reaction of cobalt tetracarbonyl hydride with phenylacetylene
err1999-07-01
err0
PREAI
errT.Michael Bockman; John F. Garst; Ferenc Ungváry
err分享
err收藏
How has our knowledge of dinosaur diversity through geologic time changed through research history?
err2018-02-19
err0
errOAAI
errJonathan P. Tennant; Alfio Alessandro Chiarenza; Matthew Baron
err分享
err收藏
High-Throughput Fluorogenic Assay for Determination of Botulinum Type B Neurotoxin Protease Activity
err2001-04-01
err0
PREAI
errChristine Anne; Fabrice Cornille; Christine Lenoir; Bernard P. Roques
err分享
err收藏
学者 查看更多内容