.png){kind=icon}
.png){kind=icon}
Return
Hare: A Systematic Framework for Efficient and Generally Automatic Hotspot Offloading on Programmable Switches
.png){kind=icon}
PRE
AI
DOI：10.1109/TON.2024.3524580.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Switch-based hotspot offloading is a trendy solution for latency-sensitive applications to achieve high system throughput with an acceptable P99 query response latency. However, due to the varying object sizes, dynamic workloads, and complex query-processing functions of the latency-sensitive applications, existing switch-based dynamic hotspot offloading approaches struggle to handle these applications effectively. This is mainly because of their inefficient switch resource utilization and non-generalizable hotspot offloading designs. So we propose Hare, a systematic framework that consists of three techniques to address these issues. First, Hare uses a MAT-based cross-stage structure to store and perform hit-checks for large hotspots on the switch data plane. Second, Hare uses a switch-server co-offloading mechanism to support fast and precise offloading. Third, Hare is designed to enable generally automatic offloading by decoupling application-related query processing with hotspot offloading. Compared to the state-of-the-art approaches, Hare supports $8.86\times \sim 9.97\times $ larger hotspot size, achieves $1.27 \times \sim 6.61 \times $ higher system throughput, and can recover the system throughput and the P99 query response latency within 8s.
Keywords:
Query processing
programmable switch
tail latency SLO
in-network caching
Journal
I
IF:
0
Papers:
543
Citations:
0