arrow
Return

QuickDedup: Efficient VM deduplication in cloud computing environments

delete2020-05-01
delete15
PRE
AI
S
Shweta Saharan *
G
Gaurav Somani
G
Gaurav Gupta
R
Robin Verma
M
Manoj Singh Gaur
R
Rajkumar Buyya
DOI:10.1016/j.jpdc.2020.01.002delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Deduplication is one of the major storage optimisation techniques for Virtual Machines (VMs) in cloud environment. Usually, hashing of blocks helps in identifying duplicate data blocks. This paper proposes a novel deduplication approach, QuickDedup that reduces the overall deduplication time, metadata overhead and the number of hash computations, and subsequent comparisons for the VM disk images. In addition to minimising the deduplication related metadata, which is a necessary by-product useful in checking deduplication, QuickDedup, follows novel byte comparison scheme to prepare various block classes. This way, QuickDedup eliminates or minimises the need for hash calculation and subsequent comparisons. QuickDedup performs the calculation and comparisons of hashes within the respective categories only. QuickDedup saves the space required for hash storage during deduplication and makes deduplication of VM disk images much faster. We conducted a detailed evaluation of QuickDedup on various metrics with different kinds and sizes of VM images taken from publicly available datasets. The evaluation results show a substantial improvement of up to 96% in the overall deduplication time required to deduplicate VM images apart from significant savings in metadata and storage overhead. (C) 2020 Elsevier Inc. All rights reserved.
Keywords:
Deduplication
VM disk image
Storage
Hashing performance
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Journal of Parallel and Distributed Computing cover
Journal of Parallel and Distributed Computing
IF:
4
Papers:
3.8K
Citations:
4.8K

Organization

I
indian institute of technology (iit) jammu
Scholars:
343
Papers: 295
Citations: 0
I
indian institute of technology system (iit system)
Scholars:
9.5W
Papers: 9.9W
Citations: 93
C
central university of rajasthan (curaj)
Scholars:
1.1K
Papers: 835
Citations: 0
I
Indraprastha Institute of Information Technology Delhi
Scholars:
932
Papers: 688
Citations: 558
U
university of melbourne
Scholars:
5.7W
Papers: 5.4W
Citations: 69
researcher View more organizations