arrow
返回

Filter Pruning Without Damaging Networks Capacity

delete2020-01-01
delete15
delete
OA
AI
Y
Yuding Zuo
B
Bo Chen *
T
Te Shi
M
Mengfan Sun
DOI:10.1109/ACCESS.2020.2993932delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Due to its over-parameterized design, the deep convolutional neural networks lead to a huge amount of parameters and high computational cost, making it difficult to deploy on some devices with limited computational resources in reality. In this paper, we propose a method of filter pruning without damaging networks capacity to accelerate and compress deep convolutional neural networks. Differently from some existing filter pruning methods, we pay more attention to the damage by filter pruning to model capacity. In order to restore the original model capacity, we generate new feature maps on the basis of the remaining feature maps with lighter structure after pruning the redundant filters that are similar with the others. Experimental results on CIFAR10 and CIFAR100 benchmarks demonstrate the effectiveness of our method. Especially, our method reduces more than 49 & x0025; FLOPs for VGGNet-16 on CIFAR10 with only 0.07 & x0025; relative accuracy drop. The relative accuracy has even been increased by 0.13 & x0025; with reducing more than 24 & x0025; FLOPs. Moreover, our method accelerates ResNet-110 on CIFAR10 by 22.1 & x0025; with 0.41 & x0025; accuracy improvement, which exceeds the previous methods.
Keyword:
Convolution
Nickel
Acceleration
Convolutional neural networks
Information filters
Computational modeling
Convolutional neural networks
filter pruning
filter similarity
model capacity
networks compression and acceleration

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

暂无机构信息
引用论文

引用论文

Calcium-modulating cyclophilin ligand regulates membrane trafficking of postsynaptic GABAA receptors
err2008-06-01
err0
errOAAI
errXu Yuan; Jun Yao; David Norris; David D. Tran; Richard J. Bram; Gong Chen; Bernhard Luscher
err分享
err收藏
Major Adverse Limb Events and Mortality in Patients With Peripheral Artery Disease
err2018-05-01
err0
errOAAI
errSonia S. Anand; Francois Caron; John W. Eikelboom; Jackie Bosch; Leanne Dyal; Victor Aboyans; Maria Teresa Abola; Kelley R.H. Branch; Katalin Keltai; Deepak L. Bhatt; Peter Verhamme; Keith A.A. Fox; Nancy Cook-Bruns; Vivian Lanius; Stuart J. Connolly; Salim Yusuf
err分享
err收藏
A slice of π : An exploratory neuroimaging study of digit encoding and retrieval in a superior memorist
err2009-09-09
err0
errOAAI
errAmir Raz; Mark G. Packard; Gerianne M. Alexander; Jason T. Buhle; Hongtu Zhu; Shan Yu; Bradley S. Peterson
err分享
err收藏
学者 查看更多内容