arrow
Return

Fast Data Delivery for Many-Core Processors

delete2018-10-01
delete23
PRE
AI
M
Mohammad Bakhshalipour *
P
Pejman Lotfi-Kamran
A
Abbas Mazloumi
F
Farid Samandi
M
Mahmood Naderan-Tahan
M
Mehdi Modarressi
H
Hamid Sarbazi‐Azad
DOI:10.1109/TC.2018.2821144delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Server workloads operate on large volumes of data. As a result, processors executing these workloads encounter frequent L1-D misses. In a many-core processor, an L1-D miss causes a request packet to be sent to an LLC slice and a response packet to be sent back to the L1-D, which results in high overhead. While prior work targeted response packets, this work focuses on accelerating the request packets. Unlike aggressive OoO cores, simpler cores used in many-core processors cannot hide the latency of L1-D request packets. We observe that LLC slices that serve L1-D misses are strongly temporally correlated. Taking advantage of this observation, we design a simple and accurate predictor. Upon the occurrence of an L1-D miss, the predictor identifies the LLC slice that will serve the next L1-D miss and a circuit will be set up for the upcoming miss request to accelerate its transmission. When the upcoming miss occurs, the resulting request can use the already established circuit for transmission to the LLC slice. We show that our proposal outperforms data prefetching mechanisms in a many-core processor due to (1) higher prediction accuracy and (2) not wasting valuable off-chip bandwidth, while requiring significantly less overhead. Using full-system simulation, we show that our proposal accelerates serving data misses by 22 percent and leads to 10 percent performance improvement over the state-of-the-art network-on-chip.
Keywords:
Memory system
network-on-chip
circuit switching
data prefetching
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Computers cover
IEEE Transactions on Computers
IF:
3.8
Papers:
5.3K
Citations:
9.8K

Organization

I
institute for research in fundamental sciences ipm
Scholars:
215
Papers: 161
Citations: 0
U
university of california riverside
Scholars:
1.1W
Papers: 8.3K
Citations: 16
S
Sharif University of Technology
Scholars:
1.1W
Papers: 1.1W
Citations: 9.5K
University of California System cover
University of California System
Scholars:
37.5W
Papers: 33.7W
Citations: 6.6K
S
Sahand University of Technology
Scholars:
2.8K
Papers: 2.5K
Citations: 2.2K
researcher View more organizations