.png){kind=icon}
返回
ACSL: Adaptive correlation-driven sparsity learning for deep neural network compression
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neunet.2021.09.012.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Deep convolutional neural network compression has attracted lots of attention due to the need to deploy accurate models on resource-constrained edge devices. Existing techniques mostly focus on compressing networks for image-level classification, and it is not clear if they generalize well on network architectures for more challenging pixel-level tasks, e.g., dense crowd counting or semantic segmentation. In this paper, we propose an adaptive correlation-driven sparsity learning (ACSL) framework for channel pruning that outperforms state-of-the-art methods on both image -level and pixel-level tasks. In our ACSL framework, we first quantify the data-dependent channel correlation information with a channel affinity matrix. Next, we leverage these inter-dependencies to induce sparsity into the channels with the introduced adaptive penalty strength. After removing the redundant channels, we obtain compact and efficient models, which have significantly less number of parameters while maintaining comparable performance with the original models. We demonstrate the advantages of our proposed approach on three popular vision tasks, i.e., dense crowd counting, semantic segmentation, and image-level classification. The experimental results demonstrate the superiority of our framework. In particular, for crowd counting on the Mall dataset, the proposed ACSL framework is able to reduce up to 94% parameters (VGG16-Decoder) and 84% FLOPs (ResNet101), while maintaining the same performance of (at times outperforming) the original model. (c) 2021 Elsevier Ltd. All rights reserved.
Keyword:
Network pruning
Channel correlation
Sparsity learning
Deep convolutional neural networks
期刊
IF:
6.3
论文数:
8.2K
被引数:
3.0W
机构
引用论文
ARVino - outdoor augmented reality visualisation of viticulture GIS dataARVino-葡萄栽培GIS数据的户外增强现实可视化
OAAI
OAAI分享收藏Atomic-level dispersed catalysts for PEMFCs: Progress and future prospects用于pemfc的原子级分散催化剂: 进展和未来前景.png)
EnergyChem
EnergyChemIF0
PREAI
分享收藏Calcium-modulating cyclophilin ligand regulates membrane trafficking of postsynaptic GABAA receptorsOAAI
OAAI分享收藏Electrochemically assisted micro localized grafting of aptamers in a microchannel engraved in fluorinated thermoplastic polymer Dyneon THVRSC Advances
RSC AdvancesIF0
PREAI
分享收藏
查看更多内容