arrow
Return

ARENA: Asynchronous Reconfigurable Accelerator Ring to Enable Data-Centric Parallel Computing

delete2021-12-01
delete10
delete
OA
AI
C
Cheng Tan *
C
Chenhao Xie
T
Tong Geng
A
Andrés Márquez
T
Tumeo, A
K
Kevin Barker
A
Ang Li
DOI:10.1109/TPDS.2021.3081074delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
The next generation HPC and data centers are likely to be reconfigurable and data-centric due to the trend of hardware specialization and the emergence of data-driven applications. In this article, we propose ARENA - an asynchronous reconfigurable accelerator ring architecture as a potential scenario on how the future HPC and data centers will be like. Despite using the coarse-grained reconfigurable arrays (CGRAs) as the substrate platform, our key contribution is not only the CGRA-cluster design itself, but also the ensemble of a new architecture and programming model that enables asynchronous tasking across a cluster of reconfigurable nodes, so as to bring specialized computation to the data rather than the reverse. We presume distributed data storage without asserting any prior knowledge on the data distribution. Hardware specialization occurs at runtime when a task finds the majority of data it requires are available at the present node. In other words, we dynamically generate specialized CGRA accelerators where the data reside. The asynchronous tasking for bringing computation to data is achieved by circulating the task token, which describes the dataflow graphs to be executed for a task, among the CGRA cluster connected by a fast ring network. Evaluations on a set of HPC and data-driven applications across different domains show that ARENA can provide better parallel scalability with reduced data movement (53.9 percent). Compared with contemporary compute-centric parallel models, ARENA can bring on average 4.37x speedup. The synthesized CGRAs and their task-dispatchers only occupy 2.93mm(2) chip area under 45nm process technology and can run at 800MHz with on average 759.8mW power consumption. ARENA also supports the concurrent execution of multi-applications, offering ideal architectural support for future high-performance parallel computing and data analytics systems.
Keywords:
Compute-flow-architecture
runtime reconfiguration
asynchronous parallel execution
abstract machine model
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Parallel and Distributed Systems cover
IEEE Transactions on Parallel and Distributed Systems
IF:
6
Papers:
5.2K
Citations:
1.1W

Organization

U
united states department of energy (doe)
Scholars:
11.3W
Papers: 9.6W
Citations: 246
Cited Papers

Cited Papers

The 1918 Influenza Virus: A Killer Comes into View
err2000-09-01
err0
errOAAI
errJeffery K. Taubenberger; Ann H. Reid; Thomas G. Fanning
errShare
errSave
Achieving Flexible Global Reconfiguration in NoCs Using Reconfigurable Rings
err2020-03-01
err10
PREAI
errWang, Liang; Liu, Leibo; Han, Jie; Wang, Xiaohang; Yin, Shouyi; Wei, Shaojun
errShare
errSave
GoogleWorkloads for Consumer Devices: Mitigating Data Movement Bottlenecks
err2018-03-19
err189
PREAI
errBoroumand, Amirali; Ghose, Saugata; Kim, Youngsok; Ausavarungnirun, Rachata; Shiu, Eric; Thakur, Rahul; Kim, Daehyun; Kuusela, Aki; Knies, Allan; Ranganathan, Parthasarathy; Mutlu, Onur
errShare
errSave
An Introduction to Reconfigurable Systems
err2015-03-01
err53
PREAI
errLyke, James C.; Christodoulou, Christos G.; Vera, G. Alonzo; Edwards, Arthur H.
errShare
errSave
A systematic review of the global prevalence of low back pain
err2012-05-25
err0
PREAI
errDamian Hoy; Christopher Bain; Gail Williams; Lyn March; Peter Brooks; Fiona Blyth; Anthony Woolf; Theo Vos; Rachelle Buchbinder
errShare
errSave
researcher View more