arrow
Return

Customizable Scale-Out Key-Value Stores

delete2020-09-01
delete6
delete
OA
AI
A
Ali Anwar *
Y
Yue Cheng
H
Hai Huang
H
Hyogi Sim
D
Dongyoon Lee
F
Fred Douglis
A
Ali R. Butt
DOI:10.1109/TPDS.2020.2982640delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Enterprise KV stores are often not well suited for HPC applications, and thus cumbersome end-to-end KV design customization is required to meet the needs of modern HPC applications. To this end, in this article we present bespoKV, an adaptive, extensible, and scale-out KV store framework. bespoKV decouples the KV store design into the control plane for distributed management and the data plane for local data store. For the control plane, bespoKVprovides pre-built modules, called controlets, supporting common distributed functionalities (e.g., replication, consistency, and topology) and their various combinations. This decoupling allows bespoKV to take a user-provided single-server KV store, called a datalet, and transparently enables a scalable and fault-tolerant distributed KV store service. The resulting distributed stores are also adaptive to consistency or topology requirement changes and can be easily extended for new types of services. Such specializations enable innovative uses of KV stores in HPC applications, especially for emerging applications that utilize KV-friendly workloads. We evaluate bespoKV in a local testbed as well as in a public cloud settings. Experiments show that bespoKV-enabled distributed KV stores scale horizontally to a large number of nodes, and performs comparably and sometimes 1.2x to 2.6x better than the state-of-the-art systems.
Keywords:
Topology
Distributed databases
Peer-to-peer computing
Fault tolerance
Fault tolerant systems
Nonvolatile memory
Cloud computing
Key-value stores
HPC KV stores
scale-out KV stores
application tailored storage

Journal

IEEE Transactions on Parallel and Distributed Systems cover
IEEE Transactions on Parallel and Distributed Systems
IF:
6
Papers:
5.2K
Citations:
1.1W

Organization

G
George Mason University
Scholars:
7.7K
Papers: 7.9K
Citations: 1.0W
S
stony brook university
Scholars:
1.4W
Papers: 1.0W
Citations: 20
S
state university of new york (suny) system
Scholars:
6.5W
Papers: 5.8W
Citations: 65
U
united states department of energy (doe)
Scholars:
11.3W
Papers: 9.6W
Citations: 246
I
international business machines (ibm)
Scholars:
5.7K
Papers: 4.5K
Citations: 4
O
oak ridge national laboratory
Scholars:
1.5W
Papers: 1.0W
Citations: 20
researcher View more organizations
Cited Papers

Cited Papers

Alpha Suppression and Symmetry Training for Generalized Anxiety Symptoms
err2009-08-21
err0
errOAAI
errCynthia Kerson; Richard A. Sherman; Gerald P. Kozlowski
errShare
errSave
Comparison of Basal and Adrenocorticotropin- Stimulated Plasma 21-Deoxycortisol and 17-Hydroxyprogesterone Values as Biological Markers of Late-Onset Adrenal Hyperplasia
err1988-04-01
err0
PREAI
errJEAN FIET; BERNARD GUEUX; MICHELINE GOURMELEN; FREDERIQUE KUTTENN; PATRICK VEXIAU; PHILIPPE COUILLIN; MARIE-THERESE PHAM-HUU-TRUNG; JEAN-MARIE VILLETTE; MARIECHARLES RAUX-DEMAY; HERVE GALONS; RENE JULIEN
errShare
errSave
errShare
errSave
Facile preparation of in situ coated Ti3C2Tx/Ni0.5Zn0.5Fe2O4composites and their electromagnetic performance
err2017-01-01
err0
errOAAI
errYoubing Li; Xiaobing Zhou; Jing Wang; Qihuang Deng; Mian Li; Shiyu Du; Young-Hwan Han; Jaehyung Lee; Qing Huang
errShare
errSave
Developing and Evaluating Intermodal E-Sharing Services–A Multi-method Approach
err2014-01-01
err0
errOAAI
errJörn-Ole Schröder; Christine Weiß; Martin Kagerbauer; Nicolas Reiß; Christian Reuter; Rimbert Schürmann; Steven Pfisterer
errShare
errSave
researcher View more