.png){kind=icon}
返回
A weight initialization method based on neural network with asymmetric activation function
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neucom.2022.01.088.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Weight initialization of neural networks has an important influence on the learning process, and the selection of initial weights is related to the activation interval of the activation function. It is proposed that an improved and extended weight initialization method for neural network with asymmetric activation function as an extension of the linear interval tolerance method (LIT), called 'GLIT' (generalized LIT), which is more suitable for higher-dimensional inputs. The purpose is to expand the selection range of the activation function so that the input falls in the unsaturated region, so as to improve the performance of the network. Then, a tolerance solution theorem based upon neural network system is given and proved. Furthermore, the algorithm is given about determining the initial weight interval. The validity of the theorem and algorithm is verified by numerical experiments. The input could fall into any preset interval in the sense of probability under the GLIT method. In another sense, the GLIT method could provide a theoretical basis for the further study of neural networks. (c) 2022 Elsevier B.V. All rights reserved.
Keyword:
Weight initialization
Asymmetric activation function
Interval linear system
Tolerate solution
Neural network
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
Clinical significance and diagnostic value of serum CEA, CA19-9 and CA72-4 in patients with gastric cancer.png)
Oncotarget
OAAI
OncotargetIF0
OAAI分享收藏Community pharmacy's contribution to improving the public's health: the case of weight management
OAAI
OAAI分享收藏A weight initialization method for improving training speed in feedforward neural networkNEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
分享收藏
查看更多内容