arrow
返回

A competitive learning scheme for deep neural network pattern classifier training

delete2023-10-01
delete5
PRE
AI
S
Senjing Zheng *
F
Feiying Lan
M
Marco Castellani
DOI:10.1016/j.asoc.2023.110662delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
To reduce the computational complexity of training a deep neural network architecture using large data sets of 3D scenes, a competitive learning scheme was devised. The proposed algorithm pits a neural network learning algorithm, in this case the standard Adam optimiser, against an evolutionary algorithm that is used to select the most difficult training examples. The overall scheme is similar to a predator-prey system, where the predator (the neural network) strives to optimise its ability to capture (identify) the prey (the training patterns), and the evolutionary procedure selects the prey that so far evaded capture. As a consequence of the evolutionary process, the neural network is presented only a fraction of the training examples, and the computational complexity of the learning procedure is reduced. Experimental evidence showed that the proposed scheme allows reducing the deep neural network training time on different model sets, sometimes significantly, without affecting the recognition accuracy. The proposed predator-prey scheme is fairly independent of the ANN type and training algorithm employed, and has the potential to be beneficial to a wide range of deep learning applications, where practical implementations are often hindered by the time complexity of the training process.& COPY; 2023 Elsevier B.V. All rights reserved.
Keyword:
Deep neural network
Predator-prey
Evolutionary algorithm
Pattern classification

期刊

Applied Soft Computing 封面图
Applied Soft Computing
IF:
6.6
论文数:
1.4W
被引数:
4.8W

机构

U
University of Birmingham
学者数:
4.1W
论文数: 3.8W
被引数: 5.0W
S
siemens ag
学者数:
5.6K
论文数: 4.6K
被引数: 3
引用论文

引用论文

err分享
err收藏
Co-evolution and ecosystem based problem solving
err2012-05-01
err7
errOAAI
errde Boer, Folkert K.; Hogeweg, Paulien
err分享
err收藏
OMIP 073: Analysis of human thymocyte development with a 14‐color flow cytometry panel
err2021-03-03
err0
errOAAI
errSarah‐Jolan Bremer; Laura Glau; Christina Gehbauer; Annika Boxnick; Daniel Biermann; Jörg Siegmar Sachweh; Eva Tolosa; Anna Gieras
err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
学者 查看更多内容