arrow
Return

A new EM-based training algorithm for RBF networks

delete2003-01-01
delete32
PRE
AI
M
Marcelino Lázaro
I
Ignacio Santamarı́a
DOI:10.1016/S0893-6080(02)00215-0delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper, we propose a new Expectation-Maximization (EM) algorithm which speeds up the training of feedforward networks with local activation functions such as the Radial Basis Function (RBF) network. In previously proposed approaches, at each E-step the residual is decomposed equally among the units or proportionally to the weights of the output layer. However, these approaches tend to slow down the training of networks with local activation units. To overcome this drawback in this paper we use a new E-step which applies a soft decomposition of the residual among the units. In particular, the decoupling variables are estimated as the posterior probability of a component given an input-output pattern. This adaptive decomposition takes into account the local nature of the activation function and, by allowing the RBF units to focus on different subregions of the input space, the convergence is improved. The proposed EM training algorithm has been applied to the nonlinear modeling of a MESFET transistor. (C) 2002 Elsevier Science Ltd. All rights reserved.
Keywords:
radial basis functions
generalized radial basis functions
expectation-maximization
training
MESFET
intermodulation
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neural Networks cover
Neural Networks
IF:
6.3
Papers:
7.8K
Citations:
3.0W

Organization

No organization information available
Cited Papers

Cited Papers

Quantized load distribution for tree and bus-connected processors
err2004-07-01
err0
PREAI
errGerassimos Barlas; Bharadwaj Veeravalli
errShare
errSave
errShare
errSave
errShare
errSave
A nonlinear MESFET model for intermodulation analysis using a generalized radial basis function network
err1999-04-01
err11
PREAI
errSantamaría, I; Lázaro, M; Pantaleón, CJ; García, JA; Tazón, A; Mediavilla, A
errShare
errSave
Genetic transmission of mammary tumour virus by gr mice
err2006-07-17
err0
PREAI
errRobertha Van Nie; A. A. Verstraeten; J. De Moes
errShare
errSave
Gait video-based prediction of unified Parkinson’s disease rating scale score: a retrospective study
err2023-10-05
err0
errOAAI
errKatsuki Eguchi; Ichigaku Takigawa; Shinichi Shirai; Ikuko Takahashi-Iwata; Masaaki Matsushima; Takahiro Kano; Hiroaki Yaguchi; Ichiro Yabe
errShare
errSave
researcher View more