arrow
Return

PRS: A Pattern-Directed Replication Scheme for Heterogeneous Object-Based Storage

delete2020-04-01
delete13
delete
OA
AI
J
Jiang Zhou
Y
Yong Chen *
W
Wei Xie
D
Dong Dai
S
Shuibing He
王伟平 (Weiping Wang)
DOI:10.1109/TC.2019.2954089delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Data replication is a key technique to achieve high data availability, reliability, and optimized performance in distributed storage systems. In recent years, with emerged new storage devices, heterogeneous object-based storage systems, such as a storage system with a mix of hard disk drives, solid state drives, and other non-volatile memory devices have become increasingly attractive since they combine the merits of different storage devices to deliver better promises. However, existing data replication schemes do not well consider distinct characteristics of heterogeneous storage devices yet, which could lead to suboptimal performance. This article introduces a new data replication scheme called Pattern-directed Replication Scheme (PRS) to achieve efficient data replication for heterogeneous storage systems. Different from traditional schemes, the PRS selectively replicates data objects and distributes replicas to various storage devices based on their characteristics. It aggregates objects that have I/O correlation into object groups by calculating object distance and makes replication for grouped objects according to application's data access pattern identified. In addition, the PRS uses a pseudo random algorithm to optimize replica placement by considering the storage device performance and capacity features. We have evaluated the pattern-directed replication scheme with extensive tests in Sheepdog, a typical object-based storage system. The experimental results confirm that it is a highly efficient replication scheme for heterogeneous storage systems. For instance, the read performance was improved by 105 percent to nearly 10x compared with existing replication schemes.
Keywords:
Data replication
heterogeneous storage
object-based storage
access pattern
data distribution
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Computers cover
IEEE Transactions on Computers
IF:
3.8
Papers:
5.3K
Citations:
9.8K

Organization

Texas Tech University System cover
Texas Tech University System
Scholars:
1.5W
Papers: 1.3W
Citations: 15
T
Texas Tech University
Scholars:
7.0K
Papers: 5.8K
Citations: 1.5W
I
institute of information engineering, cas
Scholars:
474
Papers: 466
Citations: 0
C
chinese academy of sciences
Scholars:
56.0W
Papers: 44.8W
Citations: 704
researcher View more organizations