.png){kind=icon}
返回
Hybrid hyperplane gradient learning algorithm for RBF neural network
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neucom.2024.127626.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Gradient-based algorithms are still popularly used for training radial basis function neural network (RBFNN). However, these algorithms may lead to the vanishing gradient (saddle point or local minimum) problem, which is one of the common problems that limit learning performance. To cope with this, a hybrid hyperplane gradient learning algorithm (HHGLA) is proposed to improve the learning performance of the RBFNN in this paper. First, a hyperplane gradient (HPG), based on a hyperspace constructed by a solution population (SP), is introduced. Thus, the search process can cross the surface of the cost function to avoid the appearance of vanishing gradient. Second, an adaptive learning rate is designed to restrict the search process into this hyperspace. Then, during the learning process, the hyperspace is constantly contracted to approximate the global optimal solution. Third, the convergence property of HHGLA-based RBFNN is thoroughly analyzed to ensure its application success. Finally, empirical comparisons of the proposed HHGLA-RBFNN are given to illustrate its superiority. The simulation results show the feasibility of HHGLA-RBFNN of accuracy.
Keyword:
Radial basis function neural network
Hyperplane gradient direction
Vanishing gradient
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
暂无机构信息
引用论文
An efficient self-organizing RBF neural network for water quality prediction一种高效的自组织RBF神经网络在水质预测中的应用.png)
NEURAL NETWORKS
NEURAL NETWORKSIF6.3
PREAI
分享收藏
Neural Network Training With Levenberg-Marquardt and Adaptable Weight Compression基于levenberg-marquardt和自适应权值压缩的神经网络训练
PREAI
分享收藏
查看更多内容