.png){kind=icon}
返回
Two-Level Genetic Algorithm for Evolving Convolutional Neural Networks for Pattern Recognition
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2021.3111175.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The aim of Neuroevolution is to find neural networks and convolutional neural network (CNN) architectures automatically through evolutionary algorithms. A crucial problem in neuroevolution is search time, since multiple CNNs must be trained during evolution. This problem has led to fitness acceleration approaches, generating a trade-off between time and fitness fidelity. Also, since search spaces for this problem usually include only a few parameters, this increases the human bias in the search. In this work, we propose a novel two-level genetic algorithm (GA) for addressing the fidelity-time trade-off problem for the fitness computation in CNNs. The first level evaluates many individuals quickly, and the second evaluates only those with the best results more finely. We also propose a search space with few restrictions, and an encoding with unexpressed genes to facilitate the crossover operation. This search space allows CNN architectures to have any sizes, shapes, and skip-connections among nodes. The two-level GA was applied to the pattern recognition problem on seven datasets, five MNIST-Variants, Fashion-MNIST, and CIFAR-10, achieving significantly better results than all those previously published. Our results show an improvement of 39.89% (4.2% error reduction) on the most complex dataset of MNIST (MRDBI), and on average 30.52% (1.35% error reduction) on all the five datasets. Furthermore, we show that our algorithm performed as well as precise-training GA, but took only the time of a fast-training GA. These results can be relevant and useful not only for image classification problems but also for GA-related problems.
Keyword:
Genetic algorithms
Convolutional neural networks
Training
Statistics
Sociology
Computer architecture
Task analysis
Convolutional neural network
automatic architecture design
deep learning
genetic algorithms
neuroevolution
image classification
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Intrusion Detection for IoT Based on Improved Genetic Algorithm and Deep Belief Network基于改进遗传算法和深度信念网络的物联网入侵检测.png)
IEEE ACCESS
OAAI
IEEE ACCESSIF3.6
OAAI分享收藏Identification of 11 Novel Homogentisate 1,2 Dioxygenase Variants in Alkaptonuria Patients and Establishment of a Novel LOVD-Based HGD Mutation DatabaseJIMD ReportsOAAI
JIMD ReportsIF0
OAAI分享收藏分享收藏Taking the Human Out of the Loop: A Review of Bayesian Optimization将人类带出循环: 贝叶斯优化的回顾PROCEEDINGS OF THE IEEE
PROCEEDINGS OF THE IEEEIF25.9
PREAI
分享收藏分享收藏
查看更多内容