arrow
Return

Fast Convolutional Neural Network with iterative and non-iterative learning

delete2022-08-01
delete1
PRE
AI
B
Brijesh Verma
DOI:10.1016/j.asoc.2022.109197delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Convolutional Neural Networks (CNNs) have achieved potentially good results for image classification. Due to their learning capabilities such networks are explored and implemented in real world applications. However, when it comes to training a CNN on large datasets without transfer learning, it takes long time and resources, due to the iterative process of weight update in fully connected layer. The backpropagation algorithm used to train the entire network suffers from slow convergence, getting trapped in a local minimum, not guaranteed to find global minimum and being hypersensitive to the learning rate set-up. Therefore, in this paper we propose a novel architecture of convolutional neural network with a non-iterative radial basis function-based classification layer which makes it more efficient for image classification tasks. This is a partially parameter free direct learning approach, which is highly beneficial in real-world applications as well as learning associated with large datasets. The proposed approach has been evaluated on four benchmark datasets such as CIFAR-10, MNIST, Digit and CE-MRI. It has achieved the accuracy scores of 99.8%, 99.8%, 98.4% and 98.3% on MNIST, Digit, CE-MRI and CIFAR-10 datasets respectively, when ResNet18 was used as backbone. Experimental results have illustrated that the proposed architecture is much better as it requires less parameter tuning, does not require handcrafted features and achieves same or higher accuracy in relatively lesser time than the standard CNN. Statistical significance tests were carried out to prove the efficiency of the proposed approach. (C) 2022 Elsevier B.V. All rights reserved.
Keywords:
Convolutional Neural Network
Image classification
Feature extraction
Radial basis function

Journal

Applied Soft Computing cover
Applied Soft Computing
IF:
6.6
Papers:
1.4W
Citations:
4.8W

Organization

C
central queensland university
Scholars:
2.7K
Papers: 3.2K
Citations: 6