arrow
返回

S-DenseNet: A DenseNet Compression Model Based on Convolution Grouping Strategy Using Skyline Method

delete2019-01-01
delete9
delete
OA
AI
X
Xin He *
H
Haitao Ma
X
Xin Qi
J
Jiarui Lu
Y
Yuhai Zhao
DOI:10.1109/ACCESS.2019.2960315delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
DenseNet has strong expressiveness in many computer vision tasks, but the complexity of its model makes it difficult to deploy to devices with limited computing resources. In this paper, we propose S-DenseNet, a compact model of DenseNet which makes the extracting features of DenseNet more comprehensively and reduces the parameter redundancy at the same time. Firstly, we investigate the parameter redundancy of DenseNet and show the possibility of compressing DenseNet. For example, we reduced its parameters by 10% as keeping in the same accuracy. Secondly, we propose an algorithm based on the Skyline method for converting standard convolution into group convolution automatically. It can choose the filter weights automatically and restore the standard convolution filter with a high sparsity one called S-Conv. Finally, we combine S-Conv with dense connections and formed a more effective network architecture, that is S-DenseNet. Experiments show that in Cifar10, Cifar100 and SVHN datasets, we use only 40% parameters and 20% FLOPs of DenseNet, and the accuracy is improved by 1%. Compared with the compression models of DenseNet and other CNNs, we use less complexity in the model and achieve higher or similar accuracy. On ImageNet dataset, compared with lightweight CNN models, traditional CNNs and their compression models, we achieve the higher or similar Top-1 accuracy with less complexity.
Keyword:
DenseNet
group convolution
model compression
skyline
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

N
northeastern university - china
学者数:
3.2W
论文数: 2.7W
被引数: 37
引用论文

引用论文

Evaluation of bendiocarb cytotoxicity in mammalian and insect cell cultures
err2012-07-01
err0
PREAI
errJana Polláková; Natália Kovalkovičová; Tomáš Csank; Juraj Pistl; Alica Kočišová; Jaroslav Legáth
err分享
err收藏
Major Adverse Limb Events and Mortality in Patients With Peripheral Artery Disease
err2018-05-01
err0
errOAAI
errSonia S. Anand; Francois Caron; John W. Eikelboom; Jackie Bosch; Leanne Dyal; Victor Aboyans; Maria Teresa Abola; Kelley R.H. Branch; Katalin Keltai; Deepak L. Bhatt; Peter Verhamme; Keith A.A. Fox; Nancy Cook-Bruns; Vivian Lanius; Stuart J. Connolly; Salim Yusuf
err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
err分享
err收藏
Boundary-Guided Feature Aggregation Network for Salient Object Detection
err2018-12-01
err36
errOAAI
errZhuge, Yunzhi; Yang, Gang; Zhang, Pingping; Lu, Huchuan
err分享
err收藏
学者 查看更多内容