arrow
Return

HSA: An Efficient Sparse CNN Accelerator Based on Kernel-Aware Hybrid Pruning

delete2025-12-24
delete0
PRE
AI
X
X.L. Liu
Q
Qiang Liu
DOI:10.1109/TVLSI.2025.3645350delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
The deployment of large-scale convolutional neural networks (CNNs) on hardware often results in reduced execution efficiency and increased hardware overhead. Prior works have addressed this challenge by employing pruning techniques to reduce parameters and computational loads. Among these techniques, fine-grained N:M pruning methods achieve high sparsity rates but at the cost of generating substantial indexing overhead and potential workload imbalance. In contrast, pattern-based pruning methods reduce indexing complexity and achieve workload balancing but suffer from low sparsity. To overcome these limitations, this article proposes a kernel-aware hybrid pruning (KAHP) method that simultaneously attains high sparsity, workload balancing, and reduced indexing overhead. Moreover, to accelerate the inference of the models pruned by the KAHP method, we design an efficient accelerator based on the systolic array architecture. Experimental results demonstrate that, compared to the N:M pruning method, the KAHP method achieves workload balancing and reduces the number of indices by up to 88.7% on ResNet-20. Compared to pattern-based pruning methods, the KAHP method achieves up to $31.8\times $ sparsity. The proposed accelerator achieves up to 93.18 GOPS/W power efficiency and 0.721 GOPS/DSP computation efficiency.
Keywords:
Accelerator
convolution neural network (CNN)
field programmable gate array (FPGA)
pruning
sparsity

Journal

I
IEEE Transactions on Very Large Scale Integration (VLSI) Systems
IF:
3.1
Papers:
522
Citations:
7.3K

Organization

T
tianjin university
Scholars:
8.0W
Papers: 5.8W
Citations: 88
Cited Papers

Cited Papers

A Hardware-Friendly High-Precision CNN Pruning Method and Its FPGA Implementation
errSENSORS
IF3.5
err2023-01-11
err10
errOAAI
errSui, Xuefu; Lv, Qunbo; Zhi, Liangjie; Zhu, Baoyu; Yang, Yuanbo; Zhang, Yu; Tan, Zheng
errShare
errSave
An Efficient Hardware Design for Accelerating Sparse CNNs With NAS-Based Models
err2022-03-01
err0
errOAAI
errYun Liang; Liqiang Lu; Yicheng Jin; Jiaming Xie; Ruirui Huang; Jiansong Zhang; Wei Lin
errShare
errSave
High PE Utilization CNN Accelerator with Channel Fusion Supporting Pattern-Compressed Sparse Neural Networks
err2020-07-01
err0
PREAI
errJingyu Wang; Songming Yu; Jinshan Yue; Zhe Yuan; Zhuqing Yuan; Huazhong Yang; Xueqing Li; Yongpan Liu
errShare
errSave
HRank: Filter Pruning Using High-Rank Feature Map
err2020-06-01
err0
errOAAI
errMingbao Lin; Rongrong Ji; Yan Wang; Yichen Zhang; Baochang Zhang; Yonghong Tian; Ling Shao
errShare
errSave
errShare
errSave
Diagonal-kernel convolutional neural networks for image classification
err2021-01-01
err0
PREAI
errGuoqing Li; Xuzhao Shen; Jiaojie Li; Jiuyang Wang
errShare
errSave
researcher View more