arrow
Return

Accelerating erasure coding by exploiting multiple repair paths in distributed storage systems

delete2024-04-12
delete1
PRE
AI
C
Chanki Kim
K
Kang-Wook Chon *
DOI:10.1007/s10586-024-04438-ydelete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
High reliability must be ensured in distributed storage systems (DSSs) to maintain the stability of warehouse-scale computing and high-performance computing (HPC) systems. For system-level reliability, a repair operation using redundant storage nodes can be used in conjunction with erasure coding (EC), which can also affect the system performance. The existing EC design mainly focused on minimizing the required bandwidth for the repair and storage overheads. However, the computing performance for EC should be considered to achieve high bandwidth in order to exploit back-end network link capacity with heterogeneous and high-speed interconnects over 10 Gbps Ethernet. In this study, a new computing acceleration method for repair operation in EC is proposed using multiple repair paths and modifying the computation kernel on the graphics processing unit (GPU) device. For the Cauchy Reed-Solomon (CRS) codes, the proposed scheme is observed to achieve sufficient repair bandwidth compared to the theoretical bound or exceed the current maximum Ethernet link bandwidth.
Keywords:
Cauchy Reed-Solomon (CRS) codes
Computing acceleration
Erasure coding
Fault-tolerant system
Graphics processing units (GPUs)
High-performance computing (HPC)

Journal

C
Cluster Computing-The Journal of Networks Software Tools and Applications
IF:
4.1
Papers:
5.1K
Citations:
7.5K

Organization

J
jeonbuk national university hospital
Scholars:
1.1K
Papers: 900
Citations: 3
J
Jeonbuk National University
Scholars:
1.3W
Papers: 1.3W
Citations: 1.3W
Cited Papers

Cited Papers

Bis(R-bipyridyl)ruthenium bibenzimidazole complexes (R = H, Me or But ): supramolecular arrangement via hydrogen bonds, photo- and electro-chemical properties and reactivity towards carbon dioxide
err2000-01-01
err0
PREAI
errSven Rau; Mario Ruben; Torsten Büttner; Christian Temme; Sylvana Dautz; Helmar Görls; Manfred Rudolph; Dirk Walther; Andre Brodkorb; Marco Duati; Christine O’Connor; Johannes G. Vos
errShare
errSave
Oxidative Ageing of Polymers
err
IF0
err2013-01-21
err0
PREAI
errJacques Verdu
errShare
errSave
Erasure coding for distributed storage: an overview
err2018-09-06
err106
PREAI
errBalaji, S. B.; Krishnan, M. Nikhil; Vajha, Myna; Ramkumar, Vinayak; Sasidharan, Birenjith; Kumar, P. Vijay
errShare
errSave
researcher View more