arrow
Return

A Low-Complexity Modified ThiNet Algorithm for Pruning Convolutional Neural Networks

delete2022-01-01
delete7
PRE
AI
S
Sadegh Tofigh
M
M. Omair Ahmad *
M
M.N.S. Swamy
DOI:10.1109/LSP.2022.3164328delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
ThiNet is a recent method for pruning convolutional neural networks. This method uses a norm of a subset of the components of the output resulting from the convolutional layer succeeding the layer from which the filters are to be removed for pruning the network. The ThiNet algorithm is very time-consuming, in view of the fact that the filters for removal are selected one by one iteratively. In this paper, we propose a modified version of ThiNet, in which the same information on the output of the same convolutional layer as used by ThiNet is employed to select all the filters together in a single step, for pruning the network. The proposed modified algorithm is shown to have a time-complexity that is only a small fraction of that of ThiNet or any other state-of-the-art algorithm and that the pruned network has almost the same reduction in its accuracy as that of the network pruned by ThiNet.
Keywords:
Signal processing algorithms
Convolution
Convolutional neural networks
Training
Testing
Tensors
Mathematical models
CNN model compression
convolutional neural networks
network pruning
ThiNet algorithm

Journal

IEEE Signal Processing Magazine cover
IEEE Signal Processing Magazine
IF:
9.6
Papers:
1.1W
Citations:
1.7W

Organization

C
concordia university - canada
Scholars:
8.0K
Papers: 8.9K
Citations: 4
Cited Papers

Cited Papers

Calcium-modulating cyclophilin ligand regulates membrane trafficking of postsynaptic GABAA receptors
err2008-06-01
err0
errOAAI
errXu Yuan; Jun Yao; David Norris; David D. Tran; Richard J. Bram; Gong Chen; Bernhard Luscher
errShare
errSave
Brain Morphological Changes and Early Marijuana Use
err2010-02-02
err0
PREAI
errWilliam Wilson; Roy Mathew; Timothy Turkington; Thomas Hawk; R. Edward Coleman; James Provenzale
errShare
errSave
Predictors of walking capacity in peripheral arterial disease patients
err2013-04-01
err0
errOAAI
errBreno Quintella Farah; João Paulo dos Anjos Souza Barbosa; Gabriel Grizzo Cucato; Marcel da Rocha Chehuen; Luis Alberto Gobbo; Nelson Wolosker; Cláudia Lúcia de Moraes Forjaz; Raphael Mendes Ritti-Dias
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
errShare
errSave
Development of Enzyme Conductometric Biosensor for Dopamine Determination in Aqueous Samples
err2021-07-28
err0
PREAI
errO. O. Soldatkin; I. S. Kucherenko; D. V. Siediuko; D. Yu. Kucherenko; S. V. Dzyadevych; A. P. Soldatkin
errShare
errSave
errShare
errSave
Viscosity of (C2–C14) 1-alkyl-3-methylimidazolium bis(trifluoromethylsulfonyl)amide ionic liquids in an extended temperature range
err2011-02-01
err0
PREAI
errMohammad Tariq; Pedro J. Carvalho; João A.P. Coutinho; Isabel M. Marrucho; José N. Canongia Lopes; Luís P.N. Rebelo
errShare
errSave
researcher View more