arrow
返回

Prefetch-aware fingerprint cache management for data deduplication systems

delete2018-06-09
delete6
PRE
AI
M
Mei Li *
H
Hongjun Zhang
Y
Yanjun Wu
C
Chen Zhao
DOI:10.1007/s11704-017-7119-0delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Data deduplication has been widely utilized in large-scale storage systems, particularly backup systems. Data deduplication systems typically divide data streams into chunks and identify redundant chunks by comparing chunk fingerprints. Maintaining all fingerprints in memory is not cost-effective because fingerprint indexes are typically very large. Many data deduplication systems maintain a fingerprint cache in memory and exploit fingerprint prefetching to accelerate the deduplication process. Although fingerprint prefetching can improve the performance of data deduplication systems by leveraging the locality of workloads, inaccurately prefetched fingerprints may pollute the cache by evicting useful fingerprints. We observed that most of the prefetched fingerprints in a wide variety of applications are never used or used only once, which severely limits the performance of data deduplication systems. We introduce a prefetch-aware fingerprint cache management scheme for data deduplication systems (PreCache) to alleviate prefetch-related cache pollution. We propose three prefetch-aware fingerprint cache replacement policies (PreCache-UNU, PreCache-UOO, and PreCache-MIX) to handle different types of cache pollution. Additionally, we propose an adaptive policy selector to select suitable policies for prefetch requests. We implement PreCache on two representative data deduplication systems (Block Locality Caching and SiLo) and evaluate its performance utilizing three real-world workloads (Kernel, MacOS, and Homes). The experimental results reveal that PreCache improves deduplication throughput by up to 32.22% based on a reduction of on-disk fingerprint index lookups and improvement of the deduplication ratio by mitigating prefetch-related fingerprint cache pollution.
Keyword:
data deduplication
fingerprint prefetch
fingerprint cache
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Frontiers of Computer Science 封面图
Frontiers of Computer Science
IF:
4.6
论文数:
1.6K
被引数:
2.8K

机构

C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

err分享
err收藏
Leach: an automatic learning cache for inline primary deduplication system
err2014-03-11
err12
PREAI
errLin, Bin; Li, Shanshan; Liao, Xiangke; Zhang, Jing; Liu, Xiaodong
err分享
err收藏
err分享
err收藏
Boafft: Distributed Deduplication for Big Data Storage in the Cloud
err2020-10-01
err30
errOAAI
errLuo, Shengmei; Zhang, Guangyan; Wu, Chengwen; Khan, Samee U.; Li, Keqin
err分享
err收藏
Pediatric cardiac transplantation: Three-dimensional printing of anatomic models for surgical planning of heart transplantation in patients with univentricular heart
err2008-10-01
err0
errOAAI
errRalf Sodian; Stefan Weber; Mathias Markert; Markus Loeff; Tim Lueth; Florian C. Weis; Sabine Daebritz; Edward Malec; Christoph Schmitz; Bruno Reichart
err分享
err收藏
A Comprehensive Study of the Past, Present, and Future of Data Deduplication
err2016-09-01
err195
errOAAI
errXia, Wen; Jiang, Hong; Feng, Dan; Douglis, Fred; Shilane, Philip; Hua, Yu; Fu, Min; Zhang, Yucheng; Zhou, Yukun
err分享
err收藏
Efficient Deduplication Techniques for Modern Backup Operation
err2011-06-01
err91
PREAI
errMin, Jaehong; Yoon, Daeyoung; Won, Youjip
err分享
err收藏
学者 查看更多内容