arrow
返回

Accelerating erasure coding by exploiting multiple repair paths in distributed storage systems

delete2024-04-12
delete1
PRE
AI
C
Chanki Kim
K
Kang-Wook Chon *
DOI:10.1007/s10586-024-04438-ydelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
High reliability must be ensured in distributed storage systems (DSSs) to maintain the stability of warehouse-scale computing and high-performance computing (HPC) systems. For system-level reliability, a repair operation using redundant storage nodes can be used in conjunction with erasure coding (EC), which can also affect the system performance. The existing EC design mainly focused on minimizing the required bandwidth for the repair and storage overheads. However, the computing performance for EC should be considered to achieve high bandwidth in order to exploit back-end network link capacity with heterogeneous and high-speed interconnects over 10 Gbps Ethernet. In this study, a new computing acceleration method for repair operation in EC is proposed using multiple repair paths and modifying the computation kernel on the graphics processing unit (GPU) device. For the Cauchy Reed-Solomon (CRS) codes, the proposed scheme is observed to achieve sufficient repair bandwidth compared to the theoretical bound or exceed the current maximum Ethernet link bandwidth.
Keyword:
Cauchy Reed-Solomon (CRS) codes
Computing acceleration
Erasure coding
Fault-tolerant system
Graphics processing units (GPUs)
High-performance computing (HPC)

期刊

C
Cluster Computing-The Journal of Networks Software Tools and Applications
IF:
4.1
论文数:
5.1K
被引数:
7.5K

机构

J
jeonbuk national university hospital
学者数:
1.1K
论文数: 900
被引数: 3
J
Jeonbuk National University
学者数:
1.3W
论文数: 1.3W
被引数: 1.3W
引用论文

引用论文

Bis(R-bipyridyl)ruthenium bibenzimidazole complexes (R = H, Me or But ): supramolecular arrangement via hydrogen bonds, photo- and electro-chemical properties and reactivity towards carbon dioxide
err2000-01-01
err0
PREAI
errSven Rau; Mario Ruben; Torsten Büttner; Christian Temme; Sylvana Dautz; Helmar Görls; Manfred Rudolph; Dirk Walther; Andre Brodkorb; Marco Duati; Christine O’Connor; Johannes G. Vos
err分享
err收藏
Oxidative Ageing of Polymers
err
IF0
err2013-01-21
err0
PREAI
errJacques Verdu
err分享
err收藏
Erasure coding for distributed storage: an overview分布式存储的擦除编码: 综述
err2018-09-06
err106
PREAI
errBalaji, S. B.; Krishnan, M. Nikhil; Vajha, Myna; Ramkumar, Vinayak; Sasidharan, Birenjith; Kumar, P. Vijay
err分享
err收藏
学者 查看更多内容