arrow
返回

Improved Convolutional Neural Network Based on Fast Exponentially Linear Unit Activation Function

delete2019-01-01
delete52
delete
OA
AI
谭丹 封面图
谭丹 (Dan Tan)
F
Fenghua Wang *
DOI:10.1109/ACCESS.2019.2948112delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
The activation functions play increasingly important roles in deep convolutional neural networks. The traditional activation functions have some problems such as gradient disappearance, neuron death and output offset, and so on. To solve these problems, we propose a new activation function in this paper, Fast Exponentially Linear Unit (FELU), aiming to speed up exponential linear calculations and reduce the time of network running. FELU has the advantages of Rectified Linear Unit (RELU) and Exponential Linear Unit (ELU), leading to have better classification accuracy and faster calculation speed. We test five traditional activation functions such as ReLU, ELU, SLU, MPELU, TReLU, and our new activation function on the cifar10, cifar100 and GTSRB data sets. Experiments show that the proposed activation function FELU not only improves the speed of the exponential calculation, reducing the time of convolutional neural network running, but also effectively enhances the noise robustness of network to improve the accuracy of classification.
Keyword:
Convolutional neural networks
Training
Mathematical model
Biological neural networks
Neurons
Noise robustness
Feature extraction
Activation function
deep learning
exponential function
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

C
china university of petroleum
学者数:
4.1W
论文数: 2.7W
被引数: 30
引用论文

引用论文

Adaptive activation functions in convolutional neural networks
err2018-01-01
err125
PREAI
errQian, Sheng; Liu, Hua; Liu, Cheng; Wu, Si; Wong, Hau San
err分享
err收藏
err分享
err收藏
A novel softplus linear unit for deep convolutional neural networks
err2017-09-01
err46
PREAI
errZhao, Huizhen; Liu, Fuxian; Li, Longyue; Luo, Chang
err分享
err收藏
Traffic sign detection and recognition using fully convolutional network guided proposals
err2016-11-01
err160
PREAI
errZhu, Yingying; Zhang, Chengquan; Zhou, Duoyou; Wang, Xinggang; Bai, Xiang; Liu, Wenyu
err分享
err收藏
学者 查看更多内容