.png){kind=icon}
返回
Developing Novel Activation Functions Based Deep Learning LSTM for Classification
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2022.3205774.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
This study proposes novel Long Short-Term Memory (LSTM)-based classifiers through developing the internal structure of LSTM neural networks using 26 state activation functions as alternatives to the traditional hyperbolic tangent (tanh) activation function. The LSTM networks have high performance in solving the vanishing gradient problem that is observed in recurrent neural networks. Performance investigations were carried out utilizing three distinct deep learning optimization algorithms to evaluate the efficiency of the proposed state activation functions-based LSTM classifiers for two different classification tasks. The simulation results demonstrate that the proposed classifiers that use the Modified Elliott, Softsign, Sech, Gaussian, Bitanh1, Bitanh2 and Wave as state activation functions trump the tanh-based LSTM classifiers in terms of classification accuracy. The proposed classifiers are encouraged to be utilized and tested for other classification tasks.
Keyword:
Logic gates
Computer architecture
Microprocessors
Deep learning
Neural networks
Task analysis
Recurrent neural networks
Long short term memory
Classification algorithms
LSTM
deep neural network
activation function
tanh gate
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
.png){kind=icon}
分享收藏Trajectory Planning and Resource Allocation of Multiple UAVs for Data Delivery in Vehicular Networks
PREAI
分享收藏
查看更多内容