.png){kind=icon}
返回
A simple and efficient architecture for trainable activation functions
.png){kind=icon}
OA
AI
DOI：10.1016/j.neucom.2019.08.065.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Automatically learning the best activation function for the task is an active topic in neural network research. At the moment, despite promising results, it is still challenging to determine a method for learning an activation function that is, at the same time, theoretically simple and easy to implement. Moreover, most of the methods proposed so far introduce new parameters or adopt different learning techniques. In this work, we propose a simple method to obtain a trained activation function which adds to the neural network local sub-networks with a small number of neurons. Experiments show that this approach could lead to better results than using a pre-defined activation function, without introducing the need to learn a large number of additional parameters. (C) 2019 Elsevier B.V. All rights reserved.
Keyword:
Neural networks
Machine learning
Activation functions
Trainable activation functions
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
分享收藏Improving deep neural networks with multi-layer maxout networks and a novel initialization method.png)
NEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
分享收藏Neural networks with non-uniform embedding and explicit validation phase to assess Granger causality具有非均匀嵌入和显式验证阶段的神经网络评估格兰杰因果关系NEURAL NETWORKSOAAI
NEURAL NETWORKSIF6.3
OAAI分享收藏Cross-linkable Polymer Matrix for Enhanced Thermal Stability of Succinonitrile-based Polymer Electrolyte in Lithium Rechargeable Batteries可交联聚合物基质，用于增强锂可充电电池中基于丁二腈的聚合物电解质的热稳定性
OAAI
OAAI分享收藏
查看更多内容