.png){kind=icon}
Return
Exploring Time Predictability for High-Bandwidth Memory Technology
.png){kind=icon}
OA
AI
DOI：10.1109/TETC.2025.3645133.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
High Bandwidth Memory (HBM) is a 3D-stacked DRAM interface standard that provides higher bandwidth, lower power consumption, and a smaller footprint than DDR4 and GDDR5. It is increasingly adopted in supercomputers, datacenters, and high-end embedded platforms, such as autonomous driving systems, where it meets the performance demands of artificial intelligence and other data-intensive workloads. Beyond raw performance, many of these applications require deterministic or bounded response times, either for hard real-time safety-critical systems or to provide Quality-of-Service (QoS) guarantees in multi-tenant HPC, datacenter, and cloud environments. While performance predictability has been extensively studied for DDR memory controllers, it remains largely unexplored for HBM. Although HBM shares some characteristics with DDR, such as command reordering to reduce data bus reversals, it introduces additional challenges, including stricter timing constraints that increase command latency within bank groups. In this work, we propose an implementable architectural model of a deterministic HBM controller that addresses these challenges, together with a quantitative closed-form analysis to fully characterize its response times. We present a complete physical implementation derived from the model and describe practical simulation and synthesis toolflows enabling extensive experimental evaluation with real-world memory-intensive workloads, also including aspects such as the impact of address-to-bank/row/column mapping on HBM command performance. The proposed controller achieves a peak throughput of 13.5 GB/s per pseudo-channel and an aggregate peak throughput of 432 GB/s while providing time predictability guarantees.
Keywords:
High-Bandwidth Memory (HBM)
predictable DRAM controllers
accelerator memory
Journal
IF:
5.4
Papers:
1.1K
Citations:
3.4K
Organization
Cited Papers
Memory Hierarchies, Pipelines, and Buses for Future Architectures in Time-Critical Embedded Systems
PREAI
ShareSaveEdge Computing for Autonomous Driving: Opportunities and Challenges.png)
PROCEEDINGS OF THE IEEE
PROCEEDINGS OF THE IEEEIF25.9
PREAI
ShareSaveShareSaveShareSaveShareSaveA mixed critical memory controller using bank privatization and fixed priority scheduling2014 IEEE 20th International Conference on Embedded and Real-Time Computing Systems and Applications
2014 IEEE 20th International Conference on Embedded and Real-Time Computing Systems and ApplicationsIF0
PREAI
ShareSave
View more