arrow
Return

Designing Programmable Accelerators for Sparse Tensor Algebra

delete2025-05-01
delete0
PRE
AI
K
Kalhan Koul
Z
Zhouhua Xie
M
Maxwell Strange
S
Sai Gautham Ravipati
B
Bo Cheng
O
Olivia Hsu
P
Po‐Han Chen
M
Mark Horowitz
F
Fredrik Kjølstad
P
Priyanka Raina
DOI:10.1109/MM.2025.3556611delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Recent research has focused on leveraging sparsity in hardware accelerators to improve the efficiency of applications spanning scientific computing to machine learning. Most such prior accelerators are fixed-function, which is insufficient for two reasons. First, applications typically include both dense and sparse components, and second, the algorithms that comprise these applications are constantly evolving. To address these challenges, we designed a programmable accelerator called Onyx for both sparse tensor algebra and dense workloads. Onyx extends a coarse-grained reconfigurable array (CGRA) optimized for dense applications with composable hardware primitives to support arbitrary sparse tensor algebra kernels. In this article, we show that we can further optimize Onyx by adding a small set of hardware features for parallelization that significantly increase both temporal and spatial utilization of the CGRA, reducing runtime by up to 6.2×.
Keywords:
Tensors
Pipeline processing
Micromechanical devices
Repeaters
Random access memory
Arrays
Sparse matrices
Process control
Hardware acceleration
Product design

Journal

IEEE Micro cover
IEEE Micro
IF:
2.9
Papers:
141
Citations:
2.7K

Organization

S
Stanford University
Scholars:
9.6W
Papers: 8.2W
Citations: 17.0W
Cited Papers

Cited Papers

Amber: A 16-nm System-on-Chip With a Coarse- Grained Reconfigurable Array for Flexible Acceleration of Dense Linear Algebra
err
IF0
err2024-03-01
err0
PREAI
errKathleen Feng; Taeyoung Kong; Kalhan Koul; Jackson Melchert; Alex Carsello; Qiaoyi Liu; Gedeon Nyengele; Maxwell Strange; Keyi Zhang; Ankita Nayak; Jeff Setter; James Thomas; Kavya Sreedhar; Po-Han Chen; Nikhil Bhagdikar; Zach A. Myers; Brandon D’Agostino; Pranil Joshi; Stephen Richardson; Christopher Torng; Mark Horowitz; Priyanka Raina
errShare
errSave
Hardware Acceleration of Sparse and Irregular Tensor Computations of ML Models: A Survey and Insights
err2021-10-01
err51
errOAAI
errDave, Shail; Baghdadi, Riyadh; Nowatzki, Tony; Avancha, Sasikanth; Shrivastava, Aviral; Li, Baoxin
errShare
errSave
The Sparse Abstract Machine
err2023-03-25
err0
errOAAI
errOlivia Hsu; Maxwell Strange; Ritvik Sharma; Jaeyeon Won; Kunle Olukotun; Joel S. Emer; Mark A. Horowitz; Fredrik Kjølstad
errShare
errSave
Trapezoid: A Versatile Accelerator for Dense and Sparse Matrix Multiplications
err
IF0
err2024-06-29
err0
PREAI
errYifan Yang; Joel S. Emer; Daniel Sanchez
errShare
errSave
Onyx: A 12nm 756 GOPS/W Coarse-Grained Reconfigurable Array for Accelerating Dense and Sparse Applications
err
IF0
err2024-06-16
err0
PREAI
errKalhan Koul; Maxwell Strange; Jackson Melchert; Alex Carsello; Yuchen Mei; Olivia Hsu; Taeyoung Kong; Po-Han Chen; Huifeng Ke; Keyi Zhang; Qiaoyi Liu; Gedeon Nyengele; Akhilesh Balasingam; Jayashree Adivarahan; Ritvik Sharma; Zhouhua Xie; Christopher Torng; Joel Emer; Fredrik Kjolstad; Mark Horowitz; Priyanka Raina
errShare
errSave
GPPU: A 330.4-μJ/ task Neural Path Planning Processor with Hybrid GNN Acceleration for Autonomous 3D Navigation
err
IF0
err2023-06-11
err0
PREAI
errSeokchan Song; Donghyeon Han; Sangjin Kim; Sangyeob Kim; Gwangtae Park; Hoi-Jun Yoo
errShare
errSave
SCNN
err2017-06-24
err0
PREAI
errAngshuman Parashar; Minsoo Rhu; Anurag Mukkara; Antonio Puglielli; Rangharajan Venkatesan; Brucek Khailany; Joel Emer; Stephen W. Keckler; William J. Dally
errShare
errSave
Efficient Processing of Deep Neural Networks
err2022-03-28
err0
PREAI
errVivienne Sze; Yu-Hsin Chen; Tien-Ju Yang; Joel S. Emer
errShare
errSave
Capstan: A Vector RDA for Sparsity
err2021-10-17
err0
errOAAI
errAlexander Rucker; Matthew Vilim; Tian Zhao; Yaqi Zhang; Raghu Prabhakar; Kunle Olukotun
errShare
errSave
researcher View more