arrow
返回

Sparse CapsNet with explicit regularizer

delete2022-04-01
delete5
PRE
AI
R
Ruiyang Shi
L
Lingfeng Niu *
R
Ruizhi Zhou *
DOI:10.1016/j.patcog.2021.108486delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Capsule Network (CapsNet) achieves great improvements in recognizing pose and deformation through a novel encoding mode. However, it carries a large number of parameters, leading to the challenge of heavy memory and computational cost. To solve this problem, we propose sparse CapsNet with an explicit reg-ularizer in this paper. To our knowledge, it's the first work that utilizes sparse optimization to com-press CapsNet. Specifically, to reduce unnecessary weight parameters, we first introduce the component-wise absolute value regularizer into the objective function of CapsNet based on zero-means Laplacian prior. Then, to reduce the computational cost and speed up CapsNet, the weight parameters are fur-ther grouped by 2D filters and sparsified by 1-norm regularization. To train our model efficiently, a new stochastic proximal gradient algorithm, which has analytical solutions at each iteration, is presented. Ex-tensive numerical experiments on four commonly used datasets validate the effectiveness and efficiency of the proposed method. (c) 2021 Elsevier Ltd. All rights reserved.
Keyword:
Capsule network
Model compression
Sparse regularization
Proximal gradient descent

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

U
university of chinese academy of sciences, cas
学者数:
4.1W
论文数: 3.8W
被引数: 75
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Synthesis and characterization of tetrathiatetraasterane
err1998-12-01
err0
PREAI
errNina V. Bojkova; Richard S. Glass
err分享
err收藏
MS-CapsNet: A Novel Multi-Scale Capsule Network
err2018-12-01
err188
errOAAI
errXiang, Canqun; Zhang, Lu; Tang, Yi; Zou, Wenbin; Xu, Chen
err分享
err收藏
Knowledge Distillation: A Survey知识蒸馏: 一项调查
err2021-03-22
err1.5K
PREAI
errGou, Jianping; Yu, Baosheng; Maybank, Stephen J.; Tao, Dacheng
err分享
err收藏
err分享
err收藏
Transformed l1 regularization for learning sparse deep neural networks
err2019-11-01
err77
PREAI
errMa, Rongrong; Miao, Jianyu; Niu, Lingfeng; Zhang, Peng
err分享
err收藏
COVID-CAPS: A capsule network-based framework for identification of COVID-19 cases from X-ray images
err2020-10-01
err382
errOAAI
errAfshar, Parnian; Heidarian, Shahin; Naderkhani, Farnoosh; Oikonomou, Anastasia; Plataniotis, Konstantinos N.; Mohammadi, Arash
err分享
err收藏
MIXCAPS: A capsule network-based mixture of experts for lung nodule malignancy prediction
err2021-08-01
err33
errOAAI
errAfshar, Parnian; Naderkhani, Farnoosh; Oikonomou, Anastasia; Rafiee, Moezedin Javad; Mohammadi, Arash; Plataniotis, Konstantinos N.
err分享
err收藏
A comprehensive survey on model compression and acceleration模型压缩与加速综述
err2020-02-08
err260
PREAI
errChoudhary, Tejalal; Mishra, Vipul; Goswami, Anurag; Sarangapani, Jagannathan
err分享
err收藏
学者 查看更多内容