arrow
Return

Sparse CapsNet with explicit regularizer

delete2022-04-01
delete5
PRE
AI
R
Ruiyang Shi
L
Lingfeng Niu *
R
Ruizhi Zhou *
DOI:10.1016/j.patcog.2021.108486delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Capsule Network (CapsNet) achieves great improvements in recognizing pose and deformation through a novel encoding mode. However, it carries a large number of parameters, leading to the challenge of heavy memory and computational cost. To solve this problem, we propose sparse CapsNet with an explicit reg-ularizer in this paper. To our knowledge, it's the first work that utilizes sparse optimization to com-press CapsNet. Specifically, to reduce unnecessary weight parameters, we first introduce the component-wise absolute value regularizer into the objective function of CapsNet based on zero-means Laplacian prior. Then, to reduce the computational cost and speed up CapsNet, the weight parameters are fur-ther grouped by 2D filters and sparsified by 1-norm regularization. To train our model efficiently, a new stochastic proximal gradient algorithm, which has analytical solutions at each iteration, is presented. Ex-tensive numerical experiments on four commonly used datasets validate the effectiveness and efficiency of the proposed method. (c) 2021 Elsevier Ltd. All rights reserved.
Keywords:
Capsule network
Model compression
Sparse regularization
Proximal gradient descent

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.4W
Citations:
4.5W

Organization

U
university of chinese academy of sciences, cas
Scholars:
4.1W
Papers: 3.8W
Citations: 75
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
Cited Papers

Cited Papers

Synthesis and characterization of tetrathiatetraasterane
err1998-12-01
err0
PREAI
errNina V. Bojkova; Richard S. Glass
errShare
errSave
MS-CapsNet: A Novel Multi-Scale Capsule Network
err2018-12-01
err188
errOAAI
errXiang, Canqun; Zhang, Lu; Tang, Yi; Zou, Wenbin; Xu, Chen
errShare
errSave
Knowledge Distillation: A Survey
err2021-03-22
err1.5K
PREAI
errGou, Jianping; Yu, Baosheng; Maybank, Stephen J.; Tao, Dacheng
errShare
errSave
errShare
errSave
Transformed l1 regularization for learning sparse deep neural networks
err2019-11-01
err77
PREAI
errMa, Rongrong; Miao, Jianyu; Niu, Lingfeng; Zhang, Peng
errShare
errSave
COVID-CAPS: A capsule network-based framework for identification of COVID-19 cases from X-ray images
err2020-10-01
err382
errOAAI
errAfshar, Parnian; Heidarian, Shahin; Naderkhani, Farnoosh; Oikonomou, Anastasia; Plataniotis, Konstantinos N.; Mohammadi, Arash
errShare
errSave
MIXCAPS: A capsule network-based mixture of experts for lung nodule malignancy prediction
err2021-08-01
err33
errOAAI
errAfshar, Parnian; Naderkhani, Farnoosh; Oikonomou, Anastasia; Rafiee, Moezedin Javad; Mohammadi, Arash; Plataniotis, Konstantinos N.
errShare
errSave
A comprehensive survey on model compression and acceleration
err2020-02-08
err260
PREAI
errChoudhary, Tejalal; Mishra, Vipul; Goswami, Anurag; Sarangapani, Jagannathan
errShare
errSave
researcher View more