返回
Sparse CapsNet with explicit regularizer
DOI:10.1016/j.patcog.2021.108486.png)
摘要
En 中文
Capsule Network (CapsNet) achieves great improvements in recognizing pose and deformation through a novel encoding mode. However, it carries a large number of parameters, leading to the challenge of heavy memory and computational cost. To solve this problem, we propose sparse CapsNet with an explicit reg-ularizer in this paper. To our knowledge, it's the first work that utilizes sparse optimization to com-press CapsNet. Specifically, to reduce unnecessary weight parameters, we first introduce the component-wise absolute value regularizer into the objective function of CapsNet based on zero-means Laplacian prior. Then, to reduce the computational cost and speed up CapsNet, the weight parameters are fur-ther grouped by 2D filters and sparsified by 1-norm regularization. To train our model efficiently, a new stochastic proximal gradient algorithm, which has analytical solutions at each iteration, is presented. Ex-tensive numerical experiments on four commonly used datasets validate the effectiveness and efficiency of the proposed method. (c) 2021 Elsevier Ltd. All rights reserved.
Keyword:
Capsule network
Model compression
Sparse regularization
Proximal gradient descent
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
COVID-CAPS: A capsule network-based framework for identification of COVID-19 cases from X-ray images
MIXCAPS: A capsule network-based mixture of experts for lung nodule malignancy prediction
PATTERN RECOGNITION
IF7.6

