arrow
返回

Extremely Sparse Networks via Binary Augmented Pruning for Fast Image Classification

delete2023-08-01
delete2
delete
OA
AI
王培松 (Peisong Wang)
F
Fanrong Li
G
Gang Li
J
Jian Cheng *
DOI:10.1109/TNNLS.2021.3120409delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Network pruning and binarization have been demonstrated to be effective in neural network accelerator design for high speed and energy efficiency. However, most existing pruning approaches achieve a poor tradeoff between accuracy and efficiency, which on the other hand, has limited the progress of neural network accelerators. At the same time, binary networks are highly efficient, however, a large accuracy gap exists between binary networks and their full-precision counterparts. In this article, we investigate the merits of extremely sparse networks with binary connections for image classification through software-hardware codesign. More specifically, we first propose a binary augmented extremely pruning method that can achieve similar to 98% sparsity with small accuracy degradation. Then we design the hardware architecture based on the resulting sparse and binary networks, which extensively explores the benefits of extreme sparsity with negligible resource consumption introduced by binary branch. Experiments on large-scale ImageNet classification and field-programmable gate array (FPGA) demonstrate that the proposed software-hardware architecture can achieve a prominent tradeoff between accuracy and efficiency.
Keyword:
Hardware acceleration
image classification
neural networks
pruning
software-hardware codesign

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.5K
被引数:
7.2W

机构

I
institute of automation, cas
学者数:
2.2K
论文数: 2.1K
被引数: 2
C
chinese academy of sciences
学者数:
56.7W
论文数: 44.9W
被引数: 704
引用论文

引用论文

err分享
err收藏
Monkeypox vaccination in the global south: Fighting a war without a weapon
err2023-07-01
err0
errOAAI
errIsaac Olushola Ogunkola; Oyinloye Emmanuel Abiodun; Babatunde Ismail Bale; Emmanuel Ebuka Elebesunu; Somtochukwu Blessing Ujam; Innocent Chimaobi Umeh; Mfoniso Tom-James; Shuaibu Saidu Musa; Emery Manirambona; Salvador B. Evardone; Don Eliseo Lucero-Prisno
err分享
err收藏
Ectomesenchymal Chondromyxoid Tumor
err2018-10-01
err0
errOAAI
errBrendan C. Dickson; Cristina R. Antonescu; Prokopios P. Argyris; Elizabeth A. Bilodeau; Martin J. Bullock; Paul D. Freedman; Douglas R. Gnepp; Richard C. Jordan; Ioannis G. Koutlas; Cheng-Han Lee; Iona Leong; Mihai Merzianu; Bibianna M. Purgina; Lester D.R. Thompson; Bret Wehrli; John M. Wright; David Swanson; Lei Zhang; Justin A. Bishop
err分享
err收藏
Calcium-modulating cyclophilin ligand regulates membrane trafficking of postsynaptic GABAA receptors
err2008-06-01
err0
errOAAI
errXu Yuan; Jun Yao; David Norris; David D. Tran; Richard J. Bram; Gong Chen; Bernhard Luscher
err分享
err收藏
Baseline characteristics in the Aliskiren Trial in Type 2 Diabetes Using Cardio-Renal Endpoints (ALTITUDE)
err2012-02-14
err0
errOAAI
errHans-Henrik Parving; Barry M Brenner; John JV McMurray; Dick de Zeeuw; Steven M Haffner; Scott D Solomon; Nish Chaturvedi; Frederik Persson; Maria Nicolaides; Alexia Richard; Zhihua Xiang; Juergen Armbrecht; Marc A Pfeffer
err分享
err收藏
Major Adverse Limb Events and Mortality in Patients With Peripheral Artery Disease
err2018-05-01
err0
errOAAI
errSonia S. Anand; Francois Caron; John W. Eikelboom; Jackie Bosch; Leanne Dyal; Victor Aboyans; Maria Teresa Abola; Kelley R.H. Branch; Katalin Keltai; Deepak L. Bhatt; Peter Verhamme; Keith A.A. Fox; Nancy Cook-Bruns; Vivian Lanius; Stuart J. Connolly; Salim Yusuf
err分享
err收藏
学者 查看更多内容