返回
S-DenseNet: A DenseNet Compression Model Based on Convolution Grouping Strategy Using Skyline Method
DOI:10.1109/ACCESS.2019.2960315.png)
摘要
En 中文
DenseNet has strong expressiveness in many computer vision tasks, but the complexity of its model makes it difficult to deploy to devices with limited computing resources. In this paper, we propose S-DenseNet, a compact model of DenseNet which makes the extracting features of DenseNet more comprehensively and reduces the parameter redundancy at the same time. Firstly, we investigate the parameter redundancy of DenseNet and show the possibility of compressing DenseNet. For example, we reduced its parameters by 10% as keeping in the same accuracy. Secondly, we propose an algorithm based on the Skyline method for converting standard convolution into group convolution automatically. It can choose the filter weights automatically and restore the standard convolution filter with a high sparsity one called S-Conv. Finally, we combine S-Conv with dense connections and formed a more effective network architecture, that is S-DenseNet. Experiments show that in Cifar10, Cifar100 and SVHN datasets, we use only 40% parameters and 20% FLOPs of DenseNet, and the accuracy is improved by 1%. Compared with the compression models of DenseNet and other CNNs, we use less complexity in the model and achieve higher or similar accuracy. On ImageNet dataset, compared with lightweight CNN models, traditional CNNs and their compression models, we achieve the higher or similar Top-1 accuracy with less complexity.
Keyword:
DenseNet
group convolution
model compression
skyline
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
The power of obfuscation techniques in malicious JavaScript code: A measurement study恶意JavaScript代码中混淆技术的功能: 一项测量研究

