.png){kind=icon}
Return
Improved Convolutional Neural Network Based on Fast Exponentially Linear Unit Activation Function
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2019.2948112.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
The activation functions play increasingly important roles in deep convolutional neural networks. The traditional activation functions have some problems such as gradient disappearance, neuron death and output offset, and so on. To solve these problems, we propose a new activation function in this paper, Fast Exponentially Linear Unit (FELU), aiming to speed up exponential linear calculations and reduce the time of network running. FELU has the advantages of Rectified Linear Unit (RELU) and Exponential Linear Unit (ELU), leading to have better classification accuracy and faster calculation speed. We test five traditional activation functions such as ReLU, ELU, SLU, MPELU, TReLU, and our new activation function on the cifar10, cifar100 and GTSRB data sets. Experiments show that the proposed activation function FELU not only improves the speed of the exponential calculation, reducing the time of convolutional neural network running, but also effectively enhances the noise robustness of network to improve the accuracy of classification.
Keywords:
Convolutional neural networks
Training
Mathematical model
Biological neural networks
Neurons
Noise robustness
Feature extraction
Activation function
deep learning
exponential function
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
3.6
Papers:
9.8W
Citations:
29.4W
Organization
Cited Papers
.png){kind=icon}
ShareSaveLung Pattern Classification for Interstitial Lung Diseases Using a Deep Convolutional Neural NetworkOAAI
OAAIShareSaveShareSaveShareSaveThe body image and object relations: exploration of a method utilizing repertory grid techniques
PREAI
ShareSaveShareSaveiPrivacy: Image Privacy Protection by Identifying Sensitive Objects via Deep Multi-Task LearningOAAI
OAAIShareSave
View more