arrow
返回

Designing Programmable Accelerators for Sparse Tensor Algebra

delete2025-05-01
delete0
PRE
AI
K
Kalhan Koul
Z
Zhouhua Xie
M
Maxwell Strange
S
Sai Gautham Ravipati
B
Bo Cheng
O
Olivia Hsu
P
Po‐Han Chen
M
Mark Horowitz
F
Fredrik Kjølstad
P
Priyanka Raina
DOI:10.1109/MM.2025.3556611delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
近期研究已聚焦于利用硬件加速器中的稀疏性,以提升涵盖科学计算到机器学习的各类应用效率。大多数此类先前的加速器均为固定功能型,这存在两方面不足:首先,应用通常包含密集和稀疏两种组件;其次,构成这些应用的算法持续演进。为应对这些挑战,我们设计了一款名为Onyx的可编程加速器,用以支持稀疏张量代数与密集型工作负载。Onyx通过可组合的硬件原语,扩展了针对密集应用优化的粗粒度可重构阵列(CGRA),以支持任意稀疏张量代数核心。本文中,我们展示了可通过添加一组用于并行化的硬件特性来进一步优化Onyx,这些特性能显著提升CGRA的时域与空域利用率,将运行时间缩短最高达6.2倍。
Keyword:
Tensors
Pipeline processing
Micromechanical devices
Repeaters
Random access memory
Arrays
Sparse matrices
Process control
Hardware acceleration
Product design

期刊

IEEE Micro 封面图
IEEE Micro
IF:
2.9
论文数:
141
被引数:
2.7K

机构

S
Stanford University
学者数:
9.6W
论文数: 8.2W
被引数: 17.0W
引用论文

引用论文

Amber: A 16-nm System-on-Chip With a Coarse- Grained Reconfigurable Array for Flexible Acceleration of Dense Linear Algebra
err
IF0
err2024-03-01
err0
PREAI
errKathleen Feng; Taeyoung Kong; Kalhan Koul; Jackson Melchert; Alex Carsello; Qiaoyi Liu; Gedeon Nyengele; Maxwell Strange; Keyi Zhang; Ankita Nayak; Jeff Setter; James Thomas; Kavya Sreedhar; Po-Han Chen; Nikhil Bhagdikar; Zach A. Myers; Brandon D’Agostino; Pranil Joshi; Stephen Richardson; Christopher Torng; Mark Horowitz; Priyanka Raina
err分享
err收藏
err分享
err收藏
The Sparse Abstract Machine稀疏抽象机
err2023-03-25
err0
errOAAI
errOlivia Hsu; Maxwell Strange; Ritvik Sharma; Jaeyeon Won; Kunle Olukotun; Joel S. Emer; Mark A. Horowitz; Fredrik Kjølstad
err分享
err收藏
Trapezoid: A Versatile Accelerator for Dense and Sparse Matrix Multiplications
err
IF0
err2024-06-29
err0
PREAI
errYifan Yang; Joel S. Emer; Daniel Sanchez
err分享
err收藏
Onyx: A 12nm 756 GOPS/W Coarse-Grained Reconfigurable Array for Accelerating Dense and Sparse Applications
err
IF0
err2024-06-16
err0
PREAI
errKalhan Koul; Maxwell Strange; Jackson Melchert; Alex Carsello; Yuchen Mei; Olivia Hsu; Taeyoung Kong; Po-Han Chen; Huifeng Ke; Keyi Zhang; Qiaoyi Liu; Gedeon Nyengele; Akhilesh Balasingam; Jayashree Adivarahan; Ritvik Sharma; Zhouhua Xie; Christopher Torng; Joel Emer; Fredrik Kjolstad; Mark Horowitz; Priyanka Raina
err分享
err收藏
GPPU: A 330.4-μJ/ task Neural Path Planning Processor with Hybrid GNN Acceleration for Autonomous 3D Navigation
err
IF0
err2023-06-11
err0
PREAI
errSeokchan Song; Donghyeon Han; Sangjin Kim; Sangyeob Kim; Gwangtae Park; Hoi-Jun Yoo
err分享
err收藏
SCNN
err2017-06-24
err0
PREAI
errAngshuman Parashar; Minsoo Rhu; Anurag Mukkara; Antonio Puglielli; Rangharajan Venkatesan; Brucek Khailany; Joel Emer; Stephen W. Keckler; William J. Dally
err分享
err收藏
Efficient Processing of Deep Neural Networks
err2022-03-28
err0
PREAI
errVivienne Sze; Yu-Hsin Chen; Tien-Ju Yang; Joel S. Emer
err分享
err收藏
Capstan: A Vector RDA for Sparsity
err2021-10-17
err0
errOAAI
errAlexander Rucker; Matthew Vilim; Tian Zhao; Yaqi Zhang; Raghu Prabhakar; Kunle Olukotun
err分享
err收藏
学者 查看更多内容