arrow
返回

CaCo: An Efficient Cauchy Coding Approach for Cloud Storage Systems

delete2016-02-01
delete14
PRE
AI
张
张广艳 (Guangyan Zhang)
S
Shupeng Wang *
舒继武 封面图
舒继武 (Jiwu Shu)
郑
郑纬民 (Weimin Zheng) *
李克勤 封面图
李克勤 (Keqin Li) *
DOI:10.1109/TC.2015.2428701delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Users of cloud storage usually assign different redundancy configurations (i.e., (k, m, w) of erasure codes, depending on the desired balance between performance and fault tolerance. Our study finds that with very low probability, one coding scheme chosen by rules of thumb, for a given redundancy configuration, performs best. In this paper, we propose CaCo, an efficient Cauchy coding approach for data storage in the cloud. First, CaCo uses Cauchy matrix heuristics to produce a matrix set. Second, for each matrix in this set, CaCo uses XOR schedule heuristics to generate a series of schedules. Finally, CaCo selects the shortest one from all the produced schedules. In such a way, CaCo has the ability to identify an optimal coding scheme, within the capability of the current state of the art, for an arbitrary given redundancy configuration. By leverage of CaCo's nature of ease to parallelize, we boost significantly the performance of the selection process with abundant computational resources in the cloud. We implement CaCo in the Hadoop distributed file system and evaluate its performance by comparing with Hadoop-EC developed by Microsoft research. Our experimental results indicate that CaCo can obtain an optimal coding scheme within acceptable time. Furthermore, CaCo outperforms Hadoop-EC by 26.68-40.18 percent in the encoding time and by 38.4-52.83 percent in the decoding time simultaneously.
Keyword:
Cloud storage
fault tolerance
Reed-Solomon codes
Cauchy matrix
XOR scheduling
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Computers 封面图
IEEE Transactions on Computers
IF:
3.8
论文数:
5.4K
被引数:
9.8K

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
I
institute of information engineering, cas
学者数:
477
论文数: 469
被引数: 0
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
学者 查看更多机构
引用论文

引用论文

How has our knowledge of dinosaur diversity through geologic time changed through research history?
err2018-02-19
err0
errOAAI
errJonathan P. Tennant; Alfio Alessandro Chiarenza; Matthew Baron
err分享
err收藏
Are sex differences in navigation caused by sexually dimorphic strategies or by differences in the ability to use the strategies?
err2002-01-01
err0
PREAI
errDeborah M. Saucier; Sheryl M. Green; Jennifer Leason; Alastair MacFadden; Scott Bell; Lorin J. Elias
err分享
err收藏
Structural characterization of cubic silicon nitride
err2007-01-02
err0
PREAI
errJ. Z Jiang; K Ståhl; R. W Berg; D. J Frost; T. J Zhou; P. X Shi
err分享
err收藏
err分享
err收藏
Towards the Translation of Electroconductive Organic Materials for Regeneration of Neural Tissues
err2021-01-01
err0
errOAAI
errEleana Manousiouthakis; Junggeun Park; John G. Hardy; Joe Young Lee; Christine E. Schmidt
err分享
err收藏
学者 查看更多内容