arrow
Return

IPFSz: An Efficient Data Compression Scheme in InterPlanetary File System

delete2022-01-01
delete4
delete
OA
AI
M
Mansub Song
J
Jongbeen Han
H
Hyeonsang Eom *
DOI:10.1109/ACCESS.2022.3223107delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
InterPlanetary File System (IPFS) is a peer-to-peer (P2P) distributed file system that allows data to be shared and exchanged between connected nodes. Recently, IPFS aims to replace existing protocols used in a centralized system (e.g., HTTP) by overcoming their weaknesses such as a single point of failure and arbitrary control. However, we observe that the performance of IPFS is worse as the data size increases since it demands large numbers of storage and network I/O operations. In this paper, we present an efficient data transmission scheme in IPFS called IPFSz to improve the I/O performance of IPFS. To do this, we extend IPFS by enabling real-time compression functionality while maintaining its existing operations in IPFS. In IPFSz, we compress/decompress the data during I/O operations by using a compression algorithm, manage the states of data (e.g., compressed or decompressed), and provide a compression/decompression interface to applications. Thus, IPFSz can reduce the number of storage and network I/O operations and storage space without sacrificing the integrity of the existing IPFS. We have implemented and evaluated IPFSz on five Amazon EC2 nodes. The experimental results show that IPFSz provides higher performance by up to $7.9\times $ and saves the storage space by up to $6.3\times $ compared with existing IPFS.
Keywords:
InterPlanetary File System
Data compression
File systems
Servers
Metadata
Compression algorithms
Distributed databases
InterPlanetary file system
data compression
decentralized system
P2P network
distributed file system

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

C
Chung Ang University
Scholars:
1.3W
Papers: 1.4W
Citations: 133
S
seoul national university (snu)
Scholars:
7.2W
Papers: 6.6W
Citations: 86
Cited Papers

Cited Papers

Computing at the Edge Cloud: Performance Analysis of an Image Comparison Web Service
err2018-07-01
err0
PREAI
errAbdullah Al Amin; Shaokat Hossain; Mahtab Uddin; Nasif Muslim; Salekul Islam; Jean-Charles Gregoire
errShare
errSave
Next generation sequencing for TCR repertoire profiling: Platform‐specific features and correction algorithms
err2012-09-24
err0
errOAAI
errDmitry A. Bolotin; Ilgar Z. Mamedov; Olga V. Britanova; Ivan V. Zvyagin; Dmitriy Shagin; Svetlana V. Ustyugova; Maria A. Turchaninova; Sergey Lukyanov; Yury B. Lebedev; Dmitriy M. Chudakov
errShare
errSave
Mantle-cell lymphoma: a population-based clinical study.
err1996-04-01
err0
PREAI
errG A Velders; J C Kluin-Nelemans; C J De Boer; J Hermans; E M Noordijk; E Schuuring; M H Kramer; W A Van Deijk; J B Rahder; P M Kluin; J H Van Krieken
errShare
errSave
Familial support following childhood sexual abuse is associated with longer telomere length in adult females
err2019-01-22
err0
errOAAI
errDavid W. Sosnowski; Wendy Kliewer; Timothy P. York; Ananda B. Amstadter; Colleen K. Jackson-Cook; Marcia A. Winter
errShare
errSave
Mesitylcopper:  Tetrameric and Pentameric
err1997-09-30
err0
PREAI
errHenrik Eriksson; Mikael Håkansson
errShare
errSave
researcher View more