返回
Convolution-layer parameters optimization in Convolutional Neural Networks
DOI:10.1016/j.knosys.2022.110210.png)
摘要
En 中文
Convolutional Neural Networks (CNNs) are the most important deep learning algorithms to classify images based on their visual features. CNNs architectures are made of convolution, pooling and fully connected (FC) layers and their corresponding parameters, which affect classification performance significantly. Convolution parameters optimization for CNNs, referred as CPOCNN, is proposed in this paper. To the best of our knowledge, this is the first optimization model which assigns adaptive upper-bounds of convolution parameters depends on data dimension in current layer and number of remained layers to reach the output layer. For this task, a comprehensive mathematical model is presented for constant structures of CNNs and it is proven that more optimization space is explored in comparison with all state-of-the-art methods. In optimization process, number of convolution filters and type of pooling filters are selected randomly; dimension of pooling filters, zero-padding and stride are considered constant. CPOCNN has been evaluated on 7 publicly available datasets and compared with 53 competitive CNN models with constant and optimized structures. Interested results showed that CPOCNN not only outperforms state-of-the-art CNN methods but also enriches weak CNN models by improving their accuracies more than 35%. Source Code of this paper is available online at Github.1 (c) 2022 Elsevier B.V. All rights reserved.
Keyword:
Convolutional Neural Networks
Parameters optimization
Particle swarm optimization
Convolution filter dimension
期刊
K
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
Evolving deep convolutional neural networks by quantum behaved particle swarm optimization with binary encoding for image classification基于二进制编码的量子粒子群优化深度卷积神经网络图像分类
NEUROCOMPUTING
IF6.5
Intrapartum‐related perinatal deaths in births planned in midwifery‐led settings in Great Britain: findings and recommendations from the ESMiE confidential enquiry英国计划在助产士主导的环境中分娩的与肿瘤相关的围产期死亡: ESMiE机密调查的发现和建议
Efficient network architecture search via multiobjective particle swarm optimization based on decomposition
NEURAL NETWORKS
IF6.3

