arrow
返回

New activation functions for single layer feedforward neural network

delete2021-02-01
delete35
PRE
AI
Y
Yılmaz Koçak
G
Gülesen Üstündağ Şiray *
DOI:10.1016/j.eswa.2020.113977delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Artificial Neural Network (ANN) is a subfield of machine learning and it has been widely used by the researchers. The attractiveness of ANNs comes from their remarkable information processing capability. An important key parameter of ANN is activation function (AF). Different AFs can significantly affect the performance of an ANN, and therefore choosing a good AF is important. This study aims to introduce some new AFs that combine the advantages of predefined AFs and perform better than them. For this purpose, we propose some new AFs, which we called generalized swish, mean-swish, ReLU-swish, triple-state swish, sigmoid-algebraic, triple-state sigmoid, exponential swish, sinc-sigmoid and derivative of sigmoid AFs. Then, we compare the proposed AFs with some well-known and recently proposed AFs. To investigate the performance of these AFs, we use four different data sets, which are simulated data, optical interconnection network data, specifications of cars, and average house costs data.
Keyword:
Artificial Neural Network
Activation function
Generalized swish
ReLU-swish
Triple-state swish
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Expert Systems with Applications 封面图
Expert Systems with Applications
IF:
7.5
论文数:
3.0W
被引数:
10.2W

机构

C
Cukurova University
学者数:
3.9K
论文数: 3.1K
被引数: 3.4K
引用论文

引用论文

Community study of role of viral infections in exacerbations of asthma in 9-11 year old children
errBMJ
IF0
err1995-05-13
err0
errOAAI
errS. L Johnston; P. K Pattemore; G. Sanderson; S. Smith; F. Lampe; L. Josephs; P. Symington; S. O'Toole; S. H Myint; D. A J Tyrrell; S. T Holgate
err分享
err收藏
err分享
err收藏
A gene−brain−cognition pathway for the effect of an Alzheimer׳s risk gene on working memory in young adults
err2014-08-01
err0
errOAAI
errBenson W. Stevens; Amanda M. DiBattista; G. William Rebeck; Adam E. Green
err分享
err收藏
A simple and efficient architecture for trainable activation functions
err2019-12-01
err23
errOAAI
errApicella, Andrea; Isgro, Francesco; Prevete, Roberto
err分享
err收藏
Effect of an Adjustable Hinged Operating Table on Lumbar Lordosis During Lumbar Surgery
err2018-02-15
err0
PREAI
errArjun S. Sebastian; Amin Ahmed; Brian Vernon; Emily C. Nguyen; Ilyas Aleem; Michelle J. Clarke; Bradford L. Currier; Paul Anderson; Mohamad Bydon; Ahmad Nassr
err分享
err收藏
没有更多内容