arrow
返回

A Fast Learned Key-Value Store for Concurrent and Distributed Systems

delete2024-06-01
delete0
PRE
AI
P
Pengfei Li
Y
Yu Hua *
J
Jingnan Jia
P
Pengfei Zuo
DOI:10.1109/TKDE.2023.3327009delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Efficient key-value (KV) store becomes important for concurrent and distributed systems to deliver high performance. The promising learned indexes leverage deep-learning models to complement existing KV stores and obtain significant performance improvements. However, existing schemes show limited scalability in concurrent systems due to containing high dependency among data. The practical system performance decreases when inserting a large amount of new data due to triggering frequent and inefficient retraining operations. Moreover, existing learned indexes become inefficient in distributed systems, since different machines incur high overheads to guarantee the data consistency when the index structures dynamically change. To address these problems in concurrent and distributed systems, we propose a fine-grained learned index scheme with high scalability, called FineStore, which constructs independent models with a flattened data structure under the trained data array to concurrently process the requests with low overheads. FineStore processes the new requests in-place with the support of non-blocking retraining, hence adapting to the new distributions without blocking the systems. In the distributed systems, different machines efficiently leverage the extended RCU barrier to guarantee the data consistency. We evaluate FineStore via YCSB and real-world datasets, and extensive experimental results demonstrate that FineStore improves the performance respectively by up to 1.8x and 2.5x than state-of-the-art XIndex and Masstree. We have released the open-source codes of FineStore for public use in GitHub.
Keyword:
Computers and information processing
computer architecture
data structures
distributed computing

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.8K
被引数:
3.2W

机构

暂无机构信息
引用论文

引用论文

Metabolic profiles of pomalidomide in human plasma simulated with pharmacokinetic data in control and humanized-liver mice
err2016-11-16
err0
errOAAI
errMakiko Shimizu; Hiroshi Suemizu; Marina Mitsui; Norio Shibata; F. Peter Guengerich; Hiroshi Yamazaki
err分享
err收藏
Contemporary Trends and Outcomes of Blunt Traumatic Colon Injuries Requiring Resection
err2020-03-01
err0
PREAI
errVincent Cheng; Morgan Schellenberg; Kenji Inaba; Kazuhide Matsushima; Zachary Warriner; Marc D. Trust; Lydia Lam; Demetrios Demetriades
err分享
err收藏
Cognitive functions and aging in the dog: Acquisition of nonspatial visual tasks.
err1994-02-01
err0
PREAI
errNorton W. Milgram; Elizabeth Head; Earl Weiner; Earl Thomas
err分享
err收藏
Environmental Factors in the Etiology of Parkinson's Disease
err2016-01-05
err0
errOAAI
errCaroline M. Tanner; Biao Chen; Wen-Zhi Wang; Man-Ling Peng; Zho-Lin Liu; Xue-Ling Liang; Li Chiung Kao; David W. Gilley; Bruce S. Schoenberg
err分享
err收藏
The interference effects of non-rotated versus counter-rotated trials in visuomotor adaptation
err2007-02-14
err0
PREAI
errMark R. Hinder; Laura Walk; Daniel G. Woolley; Stephan Riek; Richard G. Carson
err分享
err收藏
err分享
err收藏
A crossbar-type high sensitivity ultraviolet photodetector array based on a one hole–one nanorod configuration via nanoimprint lithography
err2011-05-25
err0
PREAI
errHuisu Jeong; Ki Seok Kim; Yong Hwan Kim; Hyun Jeong; Hui Song; Kwang Ho Lee; Mun Seok Jeong; Deli Wang; Gun Young Jung
err分享
err收藏
err分享
err收藏
学者 查看更多内容