.png){kind=icon}
返回
A smart hybrid content-defined chunking algorithm for data deduplication in cloud storage
.png){kind=icon}
OA
AI
DOI：10.1007/s00500-023-09290-7.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The enormous growth of data requires a large amount of storage space in the cloud server, which occupies mostly by the redundant data. The deduplication technique avoids redundancy to utilize cloud storage effectively. Chunking is the process to break the data into chunks, and determine duplicates. Many algorithms exist, to handle the deduplication efficiency, reducing the chunk variance, and improving the computational overhead continue to be a challenging task. To solve the above challenge, we propose a smart chunker (SC) algorithm, which operates with hybrid chunking based on file size as file-level and content-defined chunking (CDC). File-level chunking is assigned only for less than 2 KB file size, and the exceeding file size falls with CDC. We aim optimus prime chunking (OPC) in CDC to break the chunks with prime numbers and involves a minimum number of comparisons with fewer conditions and low computation overhead. This work reduces the processing time without hash and window for computation. Thus, it provides a constant average chunk size to distribute the equal chunk variance in the cloud storage with a 17% reduction in chunk time. Our OPC result attains high throughput of more than 3.3 x, compared to other CDC algorithms.
Keyword:
Data deduplication
Cloud storage
Content-defined chunking
Hash-less chunking
Throughput
期刊
IF:
2.5
论文数:
1.0W
被引数:
2.1W
机构
引用论文
.png){kind=icon}
Characterization of the ion cathode fall region in relation to the growth rate in plasma sputter deposition离子阴极跌落区特性与等离子体溅射沉积生长率的关系
PREAI
分享收藏Apparatus for the Measurement of Vacuum Ultraviolet Optical Properties of Freshly Evaporated Films before Exposure to Air用于测量新鲜蒸发薄膜在接触空气前真空紫外光学性能的装置
PREAI
分享收藏Enhanced attribute based access control with secure deduplication for big data storage in cloud
PREAI
分享收藏Optimum deposition condition of Nb/Al multilayers for large-scale array detectors with superconducting tunnel junctionsNb/Al多层膜用于超导隧道结大规模阵列探测器的最佳沉积条件
PREAI
分享收藏
查看更多内容