Automatic basis selection techniques for RBF networks

doi:10.1016/S0893-6080(03)00118-7

Automatic basis selection techniques for RBF networks

2003-06-01

40

PRE

AI

DOI：10.1016/S0893-6080(03)00118-7

Original

Original request for help

Save

Abstract

En 中文

This paper proposes a generic criterion that defines the optimum number of basis functions for radial basis function (RBF) neural networks. The generalization performance of an RBF network relates to its prediction capability on independent test data. This performance gives a measure of the quality of the chosen model. An RBF network with an overly restricted basis gives poor predictions on new data, since the model has too little flexibility (yielding high bias and low variance). By contrast, an RBF network with too many basis functions also gives poor generalization performance since it is too flexible and fits too much of the noise on the training data (yielding low bias but high variance). Bias and variance are complementary quantities, and it is necessary to assign the number of basis function optimally in order to achieve the best compromise between them. In this paper we use Stein's unbiased risk estimator to derive an analytical criterion for assigning the appropriate number of basis functions. Two cases of known and unknown noise have been considered and the efficacy of this criterion in both situations is illustrated experimentally. The paper also shows an empirical comparison between this method and two well known classical methods, cross validation and the Bayesian information criterion, BIC. (C) 2003 Elsevier Science Ltd. All fights reserved.

Keywords:

radial basis function network

model selection

Stein's unbiased risk estimator

Bayesian information criterion

Automatic basis selection techniques for RBF networks

Abstract

AI Summary

Journal

Organization