arrow
Return

An Efficient Delta Compression Framework Seamlessly Integrated into Inline Deduplication

delete2025-11-01
delete0
PRE
AI
Y
Yucheng Zhang
W
Wenbin Zeng
H
Hong Jiang
D
Dan Feng
Z
Zichen Xu
S
Shuibing He *
M
Mingzhe Zhang
D
Dan Wu
DOI:10.1145/3721485delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Delta compression can complement data deduplication by further minimizing redundancy through the compression of non-duplicate data chunks. When adding delta compression to deduplication-based backup systems, however, two primary challenges arise that degrade performance of inline deduplication. First, extra I/Os are introduced along the critical paths of backup and restoration for retrieving base chunks, slowing the system. Second, rewriting techniques prohibit specific data chunks from serving as base chunks for delta compression to improve restore performance, resulting in a loss of compression efficiency. In this paper, we introduce LoopDelta, a framework that seamlessly integrates delta compression into in-line deduplication for backup storage, addressing the aforementioned challenges by using three techniques: (1) dual-locality-based similarity tracking leverages both logical and physical locality to detect most of the similar chunks, which, due to their locality, can be prefetched by piggybacking on routine operations during deduplication, thereby eliminating extra I/Os during backup; (2) cache-aware filter identifies base chunks requiring extra I/Os during restore and prevents their referencing, thus eliminating extra restore I/Os; and (3) inversed delta compression, which reverses the roles of base and target chunks in the traditional delta compression approach, thereby allowing for the delta compression of data chunks that are otherwise prohibited as base chunks due to rewriting techniques. Experiments show that LoopDelta increases the compression ratio by 1.28 to 11.33 times over basic deduplication, without significantly affecting backup throughput, and enhances restore performance by up to 3.57 times.
Keywords:
Delta compression
data deduplication
storage system

Journal

A
ACM Transactions on Storage
IF:
2.6
Papers:
39
Citations:
790

Organization

Z
Zhejiang University
Scholars:
1.5W
Papers: 5.2K
Citations: 17.8W
N
nanchang university
Scholars:
8.3K
Papers: 2.2K
Citations: 0
U
university of texas arlington
Scholars:
348
Papers: 221
Citations: 0
U
university of texas system
Scholars:
18.5W
Papers: 15.6W
Citations: 210
A
ant group
Scholars:
233
Papers: 116
Citations: 0
researcher View more organizations