arrow
Return

A Distributed Learned Hash Table

delete2026-02-12
delete0
PRE
AI
S
Shengze Wang
Y
Yi Liu
张晓雪 cover
张晓雪 (Xiaoxue Zhang)
L
Liting Hu
Q
Qian Chen
DOI:10.1109/TON.2026.3664088delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Distributed Hash Tables (DHTs) are pivotal in numerous high-impact key-value applications built on distributed networked systems, offering a decentralized architecture that avoids single points of failure and improves data availability. Despite their widespread utility, DHTs face substantial challenges in handling range queries, which are crucial for applications such as LLM serving, distributed storage, databases, content delivery networks, and blockchains. To address this limitation, we present LEAD, a novel system incorporating learned models within DHT structures to significantly optimize range query performance. LEAD utilizes recursive machine learning models as the Learned Hash Function to map and retrieve data across a distributed system while preserving the inherent order of data. LEAD includes the designs to minimize range query latency and message cost while maintaining high scalability and resilience to network churn. Our comprehensive evaluations, conducted in both testbed implementation and simulations, demonstrate that LEAD achieves tremendous advantages in system efficiency compared to existing range query methods in large-scale distributed systems, reducing query latency and message cost by 80% to 90%+. Furthermore, LEAD exhibits scalability and robustness against system churn, providing a robust, scalable structure for efficient data retrieval in distributed key-value systems.
Keywords:
Key-value store
learned hashing
DHT

Journal

I
IEEE Transactions on Networking
IF:
0
Papers:
551
Citations:
0

Organization

U
university of california
Scholars:
1.9W
Papers: 8.0K
Citations: 10
Cited Papers

Cited Papers

errShare
errSave
Efficient Memory Management for Large Language Model Serving with PagedAttention
err2023-10-23
err0
errOAAI
errWoosuk Kwon; Zhuohan Li; Siyuan Zhuang; Ying Sheng; Lianmin Zheng; Cody Hao Yu; Joseph Gonzalez; Hao Zhang; Ion Stoica
errShare
errSave
XIndex
err2020-02-19
err0
PREAI
errChuzhe Tang; Youyun Wang; Zhiyuan Dong; Gansen Hu; Zhaoguo Wang; Minjie Wang; Haibo Chen
errShare
errSave
Communication-Efficient Edge AI: Algorithms and Systems
err2020-01-01
err238
errOAAI
errShi, Yuanming; Yang, Kai; Jiang, Tao; Zhang, Jun; Letaief, Khaled B.
errShare
errSave
Design and evaluation of IPFS
err2022-08-22
err0
errOAAI
errDennis Trautwein; Aravindh Raman; Gareth Tyson; Ignacio Castro; Will Scott; Moritz Schubotz; Bela Gipp; Yiannis Psaras
errShare
errSave
researcher View more