arrow
Return

Convolution-layer parameters optimization in Convolutional Neural Networks

delete2023-02-01
delete12
PRE
AI
A
Abdolreza Rashno
S
Sadegh Fadaei *
DOI:10.1016/j.knosys.2022.110210delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Convolutional Neural Networks (CNNs) are the most important deep learning algorithms to classify images based on their visual features. CNNs architectures are made of convolution, pooling and fully connected (FC) layers and their corresponding parameters, which affect classification performance significantly. Convolution parameters optimization for CNNs, referred as CPOCNN, is proposed in this paper. To the best of our knowledge, this is the first optimization model which assigns adaptive upper-bounds of convolution parameters depends on data dimension in current layer and number of remained layers to reach the output layer. For this task, a comprehensive mathematical model is presented for constant structures of CNNs and it is proven that more optimization space is explored in comparison with all state-of-the-art methods. In optimization process, number of convolution filters and type of pooling filters are selected randomly; dimension of pooling filters, zero-padding and stride are considered constant. CPOCNN has been evaluated on 7 publicly available datasets and compared with 53 competitive CNN models with constant and optimized structures. Interested results showed that CPOCNN not only outperforms state-of-the-art CNN methods but also enriches weak CNN models by improving their accuracies more than 35%. Source Code of this paper is available online at Github.1 (c) 2022 Elsevier B.V. All rights reserved.
Keywords:
Convolutional Neural Networks
Parameters optimization
Particle swarm optimization
Convolution filter dimension

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

Y
Yasouj University
Scholars:
1.9K
Papers: 1.9K
Citations: 1.4K
L
Lorestan University
Scholars:
1.5K
Papers: 1.4K
Citations: 1.6K
Cited Papers

Cited Papers

Recent advances in convolutional neural networks
err2018-05-01
err3.8K
errOAAI
errGu, Jiuxiang; Wang, Zhenhua; Kuen, Jason; Ma, Lianyang; Shahroudy, Amir; Shuai, Bing; Liu, Ting; Wang, Xingxing; Wang, Gang; Cai, Jianfei; Chen, Tsuhan
errShare
errSave
errShare
errSave
Synthesis, Characterization, and Polymerization of Glycidyl Methacrylate Derivatized Dextran
err2002-05-01
err0
PREAI
errW. N. E. van Dijk-Wolthuis; O. Franssen; H. Talsma; M. J. van Steenbergen; J. J. Kettenes-van den Bosch; W. E. Hennink
errShare
errSave
Efficient network architecture search via multiobjective particle swarm optimization based on decomposition
err2020-03-01
err59
PREAI
errJiang, Jing; Han, Fei; Ling, Qinghua; Wang, Jie; Li, Tiange; Han, Henry
errShare
errSave
Carbon-dot-encapsulated molecularly imprinted mesoporous organosilica for fluorescent sensing of rhodamine 6G
err2018-01-19
err0
PREAI
errChuanfeng Cui; Juying Lei; Lingang Yang; Bin Shen; Lingzhi Wang; Jinlong Zhang
errShare
errSave
PREVALENCE OF GASTROINTESTINAL PARASITES INFECTING FISH (CLARIAS GARIEPINUS) IN QENA GOVERNORATE
err2017-04-01
err0
errOAAI
errMahmoud A. El-Seify; Khaled El-Dakhly; Asmaa Metwally; Eman Mohammed; Marwa Fawaz
errShare
errSave
Structural study of lanthanides(III) in aqueous nitrate and chloride solutions by EXAFS
err1999-02-01
err0
PREAI
errT. Yaita; H. Narita; Sh. Suzuki; Sh. Tachimori; H. Motohashi; H. Shiwaku
errShare
errSave
researcher View more