arrow
Return

An improved asynchronous batch gradient method for ridge polynomial neural network

delete2024-05-01
delete0
PRE
AI
Y
Yan Xiong *
S
Shumei He
DOI:10.1016/j.neucom.2024.127529delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The ridge polynomial neural network composed of pi -sigma modules is a typical higher -order feedforward network, which has good non-linear mapping capabilities. Due to the strong coupling of the network structure, the synchronous gradient method can easily result in significant fluctuations in updated weights. This will reduce the generalization ability of the ridge polynomial neural network for solving classification problems. In this paper, the proposed method is a novel improved asynchronous batch gradient method, and combined with the adaptive parameters of the activation function are trained synchronously. We strictly prove the convergence theorem of the improved method. The numerical experimental results also indicate that our method for training ridge polynomial neural networks can help the weight changes smoothly and the network has good generalization ability. The feasibility and effectiveness of our method are verified from both theoretical and experimental perspectives.
Keywords:
Ridge polynomial neural network
Asynchronous gradient method
Adaptive activation function
Convergence

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

U
university of science & technology liaoning
Scholars:
3.3K
Papers: 2.2K
Citations: 4
Cited Papers

Cited Papers

errShare
errSave
errShare
errSave
Adaptive activation functions in convolutional neural networks
err2018-01-01
err125
PREAI
errQian, Sheng; Liu, Hua; Liu, Cheng; Wu, Si; Wong, Hau San
errShare
errSave
Fast analogue 2π phase modulation using a liquid crystal Pi-Cell
err2023-12-01
err0
errOAAI
errLinpei Xue; Yihan Jin; Steve J. Elston; Stephen M. Morris
errShare
errSave
Measuring Highway Impacts on House Prices Using Spatial Regression
err2020-08-04
err0
errOAAI
errMarcus T. Allen; Grant W. Austin; Mushfiq Swaleheen
errShare
errSave
A survey on modern trainable activation functions
err2021-06-01
err282
errOAAI
errApicella, Andrea; Donnarumma, Francesco; Isgro, Francesco; Prevete, Roberto
errShare
errSave
Dynamic ridge polynomial neural network with Lyapunov function for time series forecasting
err2017-09-05
err19
PREAI
errWaheeb, Waddah; Ghazali, Rozaida; Hussain, Abir Jaafar
errShare
errSave
researcher View more