arrow
Return

Efficient densely connected convolutional neural networks

delete2021-01-01
delete82
PRE
AI
G
Guoqing Li
M
Meng Zhang *
J
Jiaojie Li
G
Guodong Tong
DOI:10.1016/j.patcog.2020.107610delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Recent works have shown that convolutional neural networks (CNNs) are parameter redundant, which limits the application of CNNs in Mobile devices with limited memory and computational resources. In this paper, two novel and efficient lightweight CNNs architectures are proposed, which are called DenseDsc and Dense2Net. Two proposed CNNs are densely connected and the dense connectivity facilitates feature re-use in the networks. Dense2Net adopts efficient group convolution and DenseDsc adopts more efficient depthwise separable convolution. The novel dense blocks of DenseDsc and Dense2Net improve the parameter efficiency. The proposed DenseDsc and Dense2Net are evaluated on highly competitive classification benchmark datasets (CIFAR and ImageNet). The experimental results show that DenseDsc and Dense2Net have higher accuracy than DenseNet with similar parameters or FLOPs. Compared with other efficient CNNs with less than 0.5 M parameters for CIFAR, Dense2Net and DenseDsc achieve state-of-the-art results on CIFAR-10 and CIFAR-10 0, respectively. DenseDsc and Dense2Net are very competitive in efficient CNNs with less than 1.0 M parameters on CIFAR. Furthermore, Dense2Net achieves state-of-the-art results on ImageNet in manual CNNs with less than 10 M parameters. (C) 2020 Elsevier Ltd. All rights reserved.
Keywords:
Convolutional neural networks
Classification
Parameter efficiency
Densely connected
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

S
southeast university - china
Scholars:
5.3W
Papers: 4.9W
Citations: 57
Cited Papers

Cited Papers

errShare
errSave
Recent advances in convolutional neural networks
err2018-05-01
err3.8K
errOAAI
errGu, Jiuxiang; Wang, Zhenhua; Kuen, Jason; Ma, Lianyang; Shahroudy, Amir; Shuai, Bing; Liu, Ting; Wang, Xingxing; Wang, Gang; Cai, Jianfei; Chen, Tsuhan
errShare
errSave
ImageNet Large Scale Visual Recognition Challenge
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
errShare
errSave
Macro unit-based convolutional neural network for very light-weight deep learning
err2019-07-01
err2
PREAI
errKim, Dae Ha; Lee, Min Kyu; Lee, Seung Hyun; Song, Byung Cheol
errShare
errSave
Recent advances in convolutional neural network acceleration
err2019-01-01
err245
errOAAI
errZhang, Qianru; Zhang, Meng; Chen, Tinghuan; Sun, Zhifei; Ma, Yuzhe; Yu, Bei
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Vector-kernel convolutional neural networks
err2019-02-01
err44
PREAI
errOu, Jun; Li, Yujian
errShare
errSave
A stimuli-responsive zinc-based chain framework constructed via metal–ligand directed assembly
err2013-01-01
err0
PREAI
errMengchan Fan; Zhenguo Yao; Chen Li; Yu Xia; Qi Zhang; Jingcao Dai; Zhiyong Fu
errShare
errSave
Filter-in-Filter: Low Cost CNN Improvement by Sub-filter Parameter Sharing
err2019-07-01
err9
PREAI
errXie, Guotian; Yang, Kuiyuan; Lai, Jianhuang
errShare
errSave
researcher View more