arrow
返回

An improved asynchronous batch gradient method for ridge polynomial neural network

delete2024-05-01
delete0
PRE
AI
Y
Yan Xiong *
S
Shumei He
DOI:10.1016/j.neucom.2024.127529delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The ridge polynomial neural network composed of pi -sigma modules is a typical higher -order feedforward network, which has good non-linear mapping capabilities. Due to the strong coupling of the network structure, the synchronous gradient method can easily result in significant fluctuations in updated weights. This will reduce the generalization ability of the ridge polynomial neural network for solving classification problems. In this paper, the proposed method is a novel improved asynchronous batch gradient method, and combined with the adaptive parameters of the activation function are trained synchronously. We strictly prove the convergence theorem of the improved method. The numerical experimental results also indicate that our method for training ridge polynomial neural networks can help the weight changes smoothly and the network has good generalization ability. The feasibility and effectiveness of our method are verified from both theoretical and experimental perspectives.
Keyword:
Ridge polynomial neural network
Asynchronous gradient method
Adaptive activation function
Convergence

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

U
university of science & technology liaoning
学者数:
3.3K
论文数: 2.2K
被引数: 4
引用论文

引用论文

err分享
err收藏
Adaptive activation functions in convolutional neural networks
err2018-01-01
err125
PREAI
errQian, Sheng; Liu, Hua; Liu, Cheng; Wu, Si; Wong, Hau San
err分享
err收藏
Measuring Highway Impacts on House Prices Using Spatial Regression
err2020-08-04
err0
errOAAI
errMarcus T. Allen; Grant W. Austin; Mushfiq Swaleheen
err分享
err收藏
A survey on modern trainable activation functions
err2021-06-01
err282
errOAAI
errApicella, Andrea; Donnarumma, Francesco; Isgro, Francesco; Prevete, Roberto
err分享
err收藏
Dynamic ridge polynomial neural network with Lyapunov function for time series forecasting
err2017-09-05
err19
PREAI
errWaheeb, Waddah; Ghazali, Rozaida; Hussain, Abir Jaafar
err分享
err收藏
学者 查看更多内容