arrow
返回

SIECP: Neural Network Channel Pruning based on Sequential Interval Estimation

delete2022-04-01
delete5
PRE
AI
S
Si-Bao Chen
Y
Yujie Zheng
C
Chris Ding
B
Bin Luo *
DOI:10.1016/j.neucom.2022.01.053delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Pruning is widely regarded as an effective neural network compression and acceleration method, which can significantly reduce model parameters and speed up inference. This paper proposes a novel network Channel Pruning method based on Sequential Interval Estimation (SIECP). Our method mainly solves the problem that existing methods need to sample and evaluate a large number of sub-structures or introduce a large number of parameters, which leads to slow search. Specifically, we divide the entire channel number search process into multiple stages. In each stage, we divide the channel range that needs to be estimated into multiple channel intervals by grouping and use gradient descent to optimize the number of reserved channels. At the same time, the distribution of the number of channels is counted in each interval. At the end of each search stage, we select the channel interval with the highest frequency for further search to gradually narrow the search range until the final number of channels is determined. Then, the unpruned network is pruned according to the number of channels in each layer of the network to obtain the pruned network. Extensive experiments using ResNet and MobileNet V2 as backbones on CIFAR10, CIAFR100 and Tiny-ImageNet datasets are conducted to demonstrate the effectiveness of our method. (c) 2022 Elsevier B.V. All rights reserved.
Keyword:
Model Compression
Sequential Interval Estimation
Network Pruning
Channel Pruning
Differentiable Method

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

U
university of texas system
学者数:
18.5W
论文数: 15.6W
被引数: 210
A
anhui university
学者数:
1.9W
论文数: 1.2W
被引数: 24
引用论文

引用论文

err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
Subsequent Pain or Injury After Foot and Ankle Surgery in Patients Receiving Workers’ Compensation
err2019-10-25
err0
errOAAI
errGabrielle Bui; Yubo Gao; Natalie Glass; Christopher Cychosz; John Lawrence Marsh; Phinit Phisitkul
err分享
err收藏
Asymptotic Soft Filter Pruning for Deep Convolutional Neural Networks
err2020-08-01
err135
errOAAI
errHe, Yang; Dong, Xuanyi; Kang, Guoliang; Fu, Yanwei; Yan, Chenggang; Yang, Yi
err分享
err收藏
A slice of π : An exploratory neuroimaging study of digit encoding and retrieval in a superior memorist
err2009-09-09
err0
errOAAI
errAmir Raz; Mark G. Packard; Gerianne M. Alexander; Jason T. Buhle; Hongtu Zhu; Shan Yu; Bradley S. Peterson
err分享
err收藏
Role of prostacyclin synthase in carcinogenesis
err2017-11-01
err0
PREAI
errYuka Sasaki; Tsubasa Ochiai; Masaya Takamura; Yukihiro Kondo; Chieko Yokoyama; Shuntaro Hara
err分享
err收藏
学者 查看更多内容