.png){kind=icon}
.png){kind=icon}
Return
Swarm: Efficient Logical Memory Disaggregation With Shared CXL Memory
.png){kind=icon}
PRE
AI
DOI：10.1109/TC.2025.3647947.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Memory disaggregation has become a research trend in data centers. Existing studies fall into two paths: Network-based logical memory disaggregation (LMD) and Compute Express Link (CXL)-based physical memory disaggregation (PMD). However, LMD suffers from network overhead, while PMD incurs expensive hardware costs and lacks flexibility. This paper advocates for building LMD systems on shared CXL memory, taking advantage of its low latency and cache-coherent memory access. However, shared CXL memory has severe scalability issues due to its strict coherence model. This paper introduces Swarm, an efficient LMP system built on shared CXL memory. Swarm divides shared CXL memory into small cacheable memory and large non-cacheable memory. Hardware only needs to maintain coherence for cacheable memory, while software handles coherence for non-cacheable memory, thereby enabling all CXL memory to be shared. Then, Swarm implements cross-node RPC and dynamic global memory allocation on shared CXL memory to improve performance and memory utilization. Swarm also proposes distributed computing offloading to fully leverage compute power on memory nodes for acceleration. Our evaluation shows that Swarm not only improves the throughput (e.g., by 3.6 & times; and 1.8 & times;) compared with representative network-based LMD system, AIFM and CXL-based PMD system when computing offloading is enabled but also achieves an advantage in TCO.
Keywords:
Memory management
Coherence
Hardware
Runtime
Resource management
Servers
Costs
Dynamic scheduling
Throughput
Real-time systems
Memory disaggregation
compute express link
distributed shared memory
runtime system
Journal
IF:
3.8
Papers:
5.3K
Citations:
9.8K