arrow
Return

SIECP: Neural Network Channel Pruning based on Sequential Interval Estimation

delete2022-04-01
delete5
PRE
AI
S
Si-Bao Chen
Y
Yujie Zheng
C
Chris Ding
B
Bin Luo *
DOI:10.1016/j.neucom.2022.01.053delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Pruning is widely regarded as an effective neural network compression and acceleration method, which can significantly reduce model parameters and speed up inference. This paper proposes a novel network Channel Pruning method based on Sequential Interval Estimation (SIECP). Our method mainly solves the problem that existing methods need to sample and evaluate a large number of sub-structures or introduce a large number of parameters, which leads to slow search. Specifically, we divide the entire channel number search process into multiple stages. In each stage, we divide the channel range that needs to be estimated into multiple channel intervals by grouping and use gradient descent to optimize the number of reserved channels. At the same time, the distribution of the number of channels is counted in each interval. At the end of each search stage, we select the channel interval with the highest frequency for further search to gradually narrow the search range until the final number of channels is determined. Then, the unpruned network is pruned according to the number of channels in each layer of the network to obtain the pruned network. Extensive experiments using ResNet and MobileNet V2 as backbones on CIFAR10, CIAFR100 and Tiny-ImageNet datasets are conducted to demonstrate the effectiveness of our method. (c) 2022 Elsevier B.V. All rights reserved.
Keywords:
Model Compression
Sequential Interval Estimation
Network Pruning
Channel Pruning
Differentiable Method

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

U
university of texas system
Scholars:
18.5W
Papers: 15.6W
Citations: 210
A
anhui university
Scholars:
1.9W
Papers: 1.2W
Citations: 24
Cited Papers

Cited Papers

errShare
errSave
ImageNet Large Scale Visual Recognition Challenge
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
errShare
errSave
Subsequent Pain or Injury After Foot and Ankle Surgery in Patients Receiving Workers’ Compensation
err2019-10-25
err0
errOAAI
errGabrielle Bui; Yubo Gao; Natalie Glass; Christopher Cychosz; John Lawrence Marsh; Phinit Phisitkul
errShare
errSave
Asymptotic Soft Filter Pruning for Deep Convolutional Neural Networks
err2020-08-01
err135
errOAAI
errHe, Yang; Dong, Xuanyi; Kang, Guoliang; Fu, Yanwei; Yan, Chenggang; Yang, Yi
errShare
errSave
CCPrune: Collaborative channel pruning for learning compact convolutional networks
err2021-09-01
err35
PREAI
errChen, Yanming; Wen, Xiang; Zhang, Yiwen; Shi, Weisong
errShare
errSave
A slice of π : An exploratory neuroimaging study of digit encoding and retrieval in a superior memorist
err2009-09-09
err0
errOAAI
errAmir Raz; Mark G. Packard; Gerianne M. Alexander; Jason T. Buhle; Hongtu Zhu; Shan Yu; Bradley S. Peterson
errShare
errSave
Role of prostacyclin synthase in carcinogenesis
err2017-11-01
err0
PREAI
errYuka Sasaki; Tsubasa Ochiai; Masaya Takamura; Yukihiro Kondo; Chieko Yokoyama; Shuntaro Hara
errShare
errSave
researcher View more