.png){kind=icon}
返回
Hardware Accelerator Design for Sparse DNN Inference and Training: A Tutorial
.png){kind=icon}
PRE
AI
DOI：10.1109/TCSII.2023.3344681.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Deep neural networks (DNNs) are widely used in many fields, such as artificial intelligence generated content (AIGC) and robotics. To efficiently support these tasks, the model pruning technique is developed to compress the computational and memory-intensive DNNs. However, directly executing these sparse models on a common hardware accelerator can cause significant under-utilization, since invalid data resulting from the sparse patterns leads to unnecessary computations and irregular memory accesses. This brief analyzes the critical issues in accelerating sparse models, and provides an overview of typical hardware designs for various sparse DNNs, such as convolutional neural networks (CNNs), recurrent neural networks (RNNs), generative adversarial networks (GANs), and Transformers. Following the overview, we give a practical guideline of designing efficient accelerators for sparse DNNs with qualitative metrics to evaluate hardware overhead under different cases. In addition, we highlight potential opportunities in terms of hardware/software/algorithm co-optimizations from the perspective of sparse DNN implementation, and provide insights into recent design trends for the efficient implementation of transformers with sparse attention, which facilitates large language model (LLM) deployments with high throughput and energy efficiency.
Keyword:
Hardware acceleration
sparsity
CNN
transformer
tutorial
deep learning
期刊
I
IF:
4.9
论文数:
8.8K
被引数:
2.5W
机构
引用论文
Concise Total Synthesis of Complanadine A Enabled by Pyrrole-to-Pyridine Molecular Editing.png)
Synthesis
SynthesisIF0
PREAI
分享收藏
An Efficient and Flexible Accelerator Design for Sparse Convolutional Neural Networks一种高效灵活的稀疏卷积神经网络加速器设计
PREAI
分享收藏分享收藏
查看更多内容