.png){kind=icon}
.png){kind=icon}
Return
LiquidCache: Efficient Pushdown Caching for Cloud-Native Data Analytics
.png){kind=icon}
PRE
AI
DOI：10.14778/3773731.3773741.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
We present LiquidCache, a novel pushdown-based disaggregated caching system that evaluates filters on cache servers before transmitting data to compute nodes. Our key observation is that data decoding, not filter evaluation, is the primary bottleneck in existing systems. To address this challenge, we transcode Parquet data a lightweight Liquid format and cache it for efficient filter evaluation. The Liquid format resides solely in the cache layer, requiring no changes to existing deployments and enabling easy adoption of new encodings without breaking compatibility. Through integration with Apache DataFusion and evaluation with ClickBench and TPC-H, we demonstrate that LiquidCache reduces cache CPU time by up to 10x without increasing memory footprint, and duces network traffic by two orders of magnitudes compared non-pushdown systems.
Keywords:
STORAGE
COMPRESSION
Journal
P
IF:
3.3
Papers:
556
Citations:
1.2W
