arrow
Return

DxHash: A Memory-saving Consistent Hashing Algorithm

delete2024-02-22
delete2
PRE
AI
C
Chao Dong *
F
Fang Wang
D
Dan Feng
DOI:10.1145/3631708delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Consistent Hashing (CH) algorithms are widely adopted in networks and distributed systems for their ability to achieve load balancing and minimize disruptions. However, the rise of the Internet of Things (IoT) has introduced new challenges for existing CH algorithms, characterized by high memory usage and update overhead. This article presents DxHash, a novel CH algorithm based on repeated pseudo-random number generation. DxHash offers significant benefits, including a remarkably low memory footprint, high lookup throughput, and minimal update overhead. Additionally, we introduce a weighted variant of DxHash, enabling adaptable weight adjustments to handle heterogeneous load distribution. Through extensive evaluation, we demonstrate that DxHash outperforms AnchorHash, a state-of-the-art CH algorithm, in terms of the reduction of up to 98.4% in memory footprint and comparable performance in lookup and update.
Keywords:
DxHash
consistent hashing
load balance
memory saving

Journal

ACM Transactions on Internet Technology cover
ACM Transactions on Internet Technology
IF:
4.1
Papers:
896
Citations:
1.9K

Organization

No organization information available
Cited Papers

Cited Papers

Chord: A scalable peer-to-peer lookup protocol for Internet applications
err2003-02-01
err1.8K
PREAI
errStoica, I; Morris, R; Liben-Nowell, D; Karger, DR; Kaashoek, MF; Dabek, F; Balakrishnan, H
errShare
errSave
Developing and Evaluating Intermodal E-Sharing Services–A Multi-method Approach
err2014-01-01
err0
errOAAI
errJörn-Ole Schröder; Christine Weiß; Martin Kagerbauer; Nicolas Reiß; Christian Reuter; Rimbert Schürmann; Steven Pfisterer
errShare
errSave
errShare
errSave
errShare
errSave
A Survey on DHT-Based Routing for Large-Scale Mobile Ad Hoc Networks
err2014-08-25
err33
PREAI
errAbid, Shahbaz Akhtar; Othman, Mazliza; Shah, Nadir
errShare
errSave
researcher View more