返回
A Fast Learned Key-Value Store for Concurrent and Distributed Systems
DOI:10.1109/TKDE.2023.3327009.png)
摘要
En 中文
Efficient key-value (KV) store becomes important for concurrent and distributed systems to deliver high performance. The promising learned indexes leverage deep-learning models to complement existing KV stores and obtain significant performance improvements. However, existing schemes show limited scalability in concurrent systems due to containing high dependency among data. The practical system performance decreases when inserting a large amount of new data due to triggering frequent and inefficient retraining operations. Moreover, existing learned indexes become inefficient in distributed systems, since different machines incur high overheads to guarantee the data consistency when the index structures dynamically change. To address these problems in concurrent and distributed systems, we propose a fine-grained learned index scheme with high scalability, called FineStore, which constructs independent models with a flattened data structure under the trained data array to concurrently process the requests with low overheads. FineStore processes the new requests in-place with the support of non-blocking retraining, hence adapting to the new distributions without blocking the systems. In the distributed systems, different machines efficiently leverage the extended RCU barrier to guarantee the data consistency. We evaluate FineStore via YCSB and real-world datasets, and extensive experimental results demonstrate that FineStore improves the performance respectively by up to 1.8x and 2.5x than state-of-the-art XIndex and Masstree. We have released the open-source codes of FineStore for public use in GitHub.
Keyword:
Computers and information processing
computer architecture
data structures
distributed computing
期刊
IF:
10.4
论文数:
6.8K
被引数:
3.2W
机构
暂无机构信息
引用论文
Metabolic profiles of pomalidomide in human plasma simulated with pharmacokinetic data in control and humanized-liver mice
Xenobiotica
IF0
Synthesis, characterization and comparative electrochemistry of beta and alpha tetra-[4-oxy-3-methoxybenzoic acid]-substituted Zn(II), Co(II) and Cu(II) phthalocyanines
Polyhedron
IF0

