arrow
Return

CMCache: An Adaptive Cross-Level Data Placement Method for Multilevel Cache

delete2025-01-01
delete0
PRE
AI
Z
Zhaoyang Zeng
谭玉娟 (Yujuan Tan)
Z
Zhulin Ma
J
Jiali Li
S
Sanle Zhao
D
Duo Liu
X
Xianzhang Chen
A
Ao Ren
DOI:10.1109/TCAD.2025.3534116delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Multilevel cache systems enhance I/O performance by optimizing data placement across various cache levels from a global perspective. However, existing methods often struggle to place data at the optimal cache level promptly due to their reliance on historical access patterns and inflexible placement strategies. These methods face two main challenges: 1) for already cached data with sufficient access history, existing approaches only optimize movement between adjacent cache levels, potentially delaying data arrival at its globally optimal cache level and leading to unnecessary bandwidth consumption and increased latency and 2) for newly entered data without access history, current methods cannot accurately predict their future hotness and simply place them at a fixed cache level (i.e., first or final level), overlooking future accesses of new data and potentially resulting in high cache miss rates or cache pollution. To address these issues, we propose CMCache, an adaptive cross-level data placement method for multilevel cache. CMCache applies distinct placement strategies for cached and new data to reach the optimal level timely, considering their different characteristics. It also logically divides cache space into two sections to manage cached and new data separately, dynamically adjusting section sizes based on access patterns. This approach significantly improves data placement efficiency, achieving up to an 89% reduction in miss rates and a 79% decrease in average response times compared to existing methods.
Keywords:
Cache management
data placement
multilevel cache
storage system

Journal

I
IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
IF:
2.9
Papers:
564
Citations:
9.6K

Organization

C
Chongqing University
Scholars:
5.1W
Papers: 4.1W
Citations: 6.0W
C
Chongqing University of Posts and Telecommunications
Scholars:
2.3K
Papers: 910
Citations: 3.8K