arrow
Return

An improved backpropagation algorithm to avoid the local minima problem

delete2004-01-01
delete101
PRE
AI
X
X.G. Wang
Z
Zheng Tang
H
Hiroki Tamura
M
Masahiro Ishii
W
Weidong Sun
DOI:10.1016/j.neucom.2003.08.006delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We propose an improved backpropagation algorithm intended to avoid the local minima problem caused by neuron saturation in the hidden layer. Each training pattern has its own activation functions of neurons in the hidden layer. When the network outputs have not got their desired signals, the activation functions are adapted so as to prevent neurons in the hidden layer from saturating. Simulations on some benchmark problems have been performed to demonstrate the validity of the proposed method. (C) 2003 Elsevier B.V. All rights reserved.
Keywords:
backpropagation
local minima
saturation
gain parameter
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

No organization information available