arrow
Return

SAP: Shared-Aware Prefetching for Reducing Inter-Chiplet Data Access Latency

delete2026-01-01
delete0
PRE
AI
J
Junpei Huang
H
Haobo Xu
Y
Yiming Gan
Y
Ying Li
W
Wenhao Sun
M
Mengdi Wang
X
Xiaotong Wei
冯敏 cover
冯敏 (Min Feng)
Y
Ying Wang
Y
Yinhe Han *
DOI:10.1109/LCA.2026.3658371delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In multi-chiplet systems, inter-chiplet shared-data transfers pose a significant bottleneck, prolonging the critical paths of memory accesses. In inter-chiplet coherence traffic, since each chiplet often needs to wait reactively for data from remote chiplets, proactive data-fetching mechanisms such as prefetching are essential to anticipate inter-chiplet data accesses and mitigate latency. Nevertheless, traditional prefetchers are inadequate for explicitly handling inter-chiplet shared-data transfers, overlooking potential prefetching opportunities. To overcome this limitation, we propose SAP, a shared-aware prefetching mechanism that minimizes inter-chiplet data access latency. By transforming the IO chiplet into an active prefetching agent, SAP proactively fetches inter-chiplet shared data before demand requests arrive, utilizing a sharing table to track recent shared-data events and a prefetch agent to initiate inter-chiplet data transfers early. Our experiments on a chiplet-based system demonstrate that SAP improves system throughput by 13.44% and reduces execution time by 12.33% compared to the prior design.
Keywords:
Chiplets
Prefetching
Coherence
Probes
Vectors
Computer architecture
Indexes
Delays
Transforms
Throughput
Multi-chiplet
prefetch
shared-memory access

Journal

I
IEEE Computer Architecture Letters
IF:
1.4
Papers:
42
Citations:
781

Organization

U
university of science & technology of china, cas
Scholars:
3.2W
Papers: 2.7W
Citations: 74
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
Cited Papers

Cited Papers

Hermes: Accelerating Long-Latency Load Requests via Perceptron-Based Off-Chip Load Prediction
err2022-10-01
err0
errOAAI
errRahul Bera; Konstantinos Kanellopoulos; Shankar Balachandran; David Novo; Ataberk Olgun; Mohammad Sadrosadat; Onur Mutlu
errShare
errSave
Berti: an Accurate Local-Delta Data Prefetcher
err2022-10-01
err0
errOAAI
errAgustin Navarro-Torres; Biswabandan Panda; Jesus Alastruey-Benede; Pablo Ibanez; Victor Vinals-Yufera; Alberto Ros
errShare
errSave
The gem5 simulator
err2011-08-31
err0
PREAI
errNathan Binkert; Bradford Beckmann; Gabriel Black; Steven K. Reinhardt; Ali Saidi; Arkaprava Basu; Joel Hestness; Derek R. Hower; Tushar Krishna; Somayeh Sardashti; Rathijit Sen; Korey Sewell; Muhammad Shoaib; Nilay Vaish; Mark D. Hill; David A. Wood
errShare
errSave
errShare
errSave
Splash-4: A Modern Benchmark Suite with Lock-Free Constructs
err2022-11-01
err0
PREAI
errGomez-Hernandez,Eduardo Jose; Cebrian,Juan M.; Kaxiras,Stefanos; Ros,Alberto
errShare
errSave
Path confidence based lookahead prefetching
err2016-10-01
err0
PREAI
errJinchun Kim; Seth H. Pugsley; Paul V. Gratz; A.L. Narasimha Reddy; Chris Wilkerson; Zeshan Chishti
errShare
errSave
no more