arrow
Return

Offloading distributed key-value stores with off-path SmartNICs

delete2025-05-01
delete0
PRE
AI
S
Shangyi Sun
R
Rui Zhang
M
Ming Yan
X
Xiangyu Wu *
DOI:10.1016/j.comnet.2025.111197delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In data center networks, applications such as distributed key-value stores consume a lot of CPU resources. The performance of the entire system drops significantly under heavy load conditions. To improve the performance of key-value stores, many existing studies use RDMA (Remote Direct Memory Access) to reduce the communication overhead. However, RDMA primitives can only offload simple operations to the NIC, such as reading and writing remote memory. With the emergence of new hardware like SmartNICs, we consider whether we can offload more complex operations in distributed key-value stores to SmartNICs to reduce the load on CPU. In this paper we present SKV, a SmartNIC-offloaded distributed key-value store. In order to make full use of the offload ability of the SmartNIC, we make a detailed analysis on the characteristic and architecture of SmartNICs and distributed key-value stores. SKV offloads operations such as data replication to the SmartNIC. We design a new replication mechanism, which enables the server to separate background processing from the interaction with clients in the front. In addition, we propose a parallel offloading method to further improve the performance of key-value stores. We implement SKV on the Mellanox BlueField SmartNIC. Our evaluations show that SKV improves the overall throughput and reduces the latency compared with baseline.
Keywords:
SmartNIC
Key-value store
Offloading

Journal

Computer Networks cover
Computer Networks
IF:
4.6
Papers:
1.5K
Citations:
1.6W

Organization

No organization information available