arrow
返回

Designing efficient convolutional neural network structure: A survey

delete2022-06-01
delete11
PRE
AI
J
Jian‐Xun Mi *
J
Jie Feng
K
Ke-Yang Huang
DOI:10.1016/j.neucom.2021.08.158delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Asa powerful machine learning method, deep learning has attracted the attention of numerous research -ers. While exploring a high-performance neural network model, the floating-point operations of a neural network model are also increasing. In recent years, many researchers have noticed that efficiency is also one of important indicators to measure the property of neural network models. Obviously, the efficient neural network model is more helpful to deploy on mobile and embedded devices. Therefore, the efficient neural network model becomes a hot research spot. In this paper, we review the methods related to the structural design of efficient convolution neural networks in recent years. According to the characteristics of these methods, we divide them into three kinds of methods: model pruning, efficient architecture, and neural architecture search. Detailed analyses of each method are presented to demonstrate their advan-tages and disadvantages. Then, we comprehensively compare them in detail and propose many sugges-tions about the design of the efficient convolution neural network model structure. Inspired by these suggestions, we built a new efficient neural network model, SharedNet. And the SharedNet obtains the best accuracy of manually-designed efficient CNN models on the ImageNet dataset.(c) 2022 Elsevier B.V. All rights reserved.
Keyword:
Deep learning
Model structure design
Efficient convolution
Neural architecture search

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

C
chongqing university of posts & telecommunications
学者数:
6.7K
论文数: 5.3K
被引数: 5
引用论文

引用论文

Calcium-modulating cyclophilin ligand regulates membrane trafficking of postsynaptic GABAA receptors
err2008-06-01
err0
errOAAI
errXu Yuan; Jun Yao; David Norris; David D. Tran; Richard J. Bram; Gong Chen; Bernhard Luscher
err分享
err收藏
Palmprint recognition with 2DPCA+PCA based on modular neural networks
err2007-12-01
err67
PREAI
errZhao, Zhong-Qiu; Huang, De-Shuang; Jia, Wei
err分享
err收藏
学者 查看更多内容