返回
Filter Pruning Without Damaging Networks Capacity
DOI:10.1109/ACCESS.2020.2993932.png)
摘要
En 中文
Due to its over-parameterized design, the deep convolutional neural networks lead to a huge amount of parameters and high computational cost, making it difficult to deploy on some devices with limited computational resources in reality. In this paper, we propose a method of filter pruning without damaging networks capacity to accelerate and compress deep convolutional neural networks. Differently from some existing filter pruning methods, we pay more attention to the damage by filter pruning to model capacity. In order to restore the original model capacity, we generate new feature maps on the basis of the remaining feature maps with lighter structure after pruning the redundant filters that are similar with the others. Experimental results on CIFAR10 and CIFAR100 benchmarks demonstrate the effectiveness of our method. Especially, our method reduces more than 49 & x0025; FLOPs for VGGNet-16 on CIFAR10 with only 0.07 & x0025; relative accuracy drop. The relative accuracy has even been increased by 0.13 & x0025; with reducing more than 24 & x0025; FLOPs. Moreover, our method accelerates ResNet-110 on CIFAR10 by 22.1 & x0025; with 0.41 & x0025; accuracy improvement, which exceeds the previous methods.
Keyword:
Convolution
Nickel
Acceleration
Convolutional neural networks
Information filters
Computational modeling
Convolutional neural networks
filter pruning
filter similarity
model capacity
networks compression and acceleration
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
暂无机构信息
引用论文
Calcium-modulating cyclophilin ligand regulates membrane trafficking of postsynaptic GABAA receptors

