Return
A new EM-based training algorithm for RBF networks
DOI:10.1016/S0893-6080(02)00215-0.png)
Abstract
En 中文
In this paper, we propose a new Expectation-Maximization (EM) algorithm which speeds up the training of feedforward networks with local activation functions such as the Radial Basis Function (RBF) network. In previously proposed approaches, at each E-step the residual is decomposed equally among the units or proportionally to the weights of the output layer. However, these approaches tend to slow down the training of networks with local activation units. To overcome this drawback in this paper we use a new E-step which applies a soft decomposition of the residual among the units. In particular, the decoupling variables are estimated as the posterior probability of a component given an input-output pattern. This adaptive decomposition takes into account the local nature of the activation function and, by allowing the RBF units to focus on different subregions of the input space, the convergence is improved. The proposed EM training algorithm has been applied to the nonlinear modeling of a MESFET transistor. (C) 2002 Elsevier Science Ltd. All rights reserved.
Keywords:
radial basis functions
generalized radial basis functions
expectation-maximization
training
MESFET
intermodulation
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
6.3
Papers:
7.8K
Citations:
3.0W
Organization
No organization information available
Cited Papers
A nonlinear MESFET model for intermodulation analysis using a generalized radial basis function network
NEUROCOMPUTING
IF6.5

