arrow
Return

The evidence framework applied to sparse kernel logistic regression

delete2005-03-01
delete9
PRE
AI
G
Gavin C. Cawley
N
Nicola L. C. Talbot
DOI:10.1016/j.neucom.2004.11.021delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper we present a simple hierarchical Bayesian treatment of the sparse kernel logistic regression (KLR) model based on the evidence framework introduced by MacKay. The principal innovation lies in the re-parameterisation of the model such that the usual spherical Gaussian prior over the parameters in the kernel-induced feature space also corresponds to a spherical Gaussian prior over the transformed parameters, permitting the straight-forward derivation of an efficient update formula for the regularisation parameter. The Bayesian framework also allows the selection of good values for kernel parameters through maximisation of the marginal likelihood, or evidence, for the model. Results obtained on a variety of benchmark data sets are provided indicating that the Bayesian KLR model is competitive with KLR models, where the hyper-parameters are selected via cross-validation and with the support vector machine and relevance vector machine. (c) 2004 Elsevier B.V. All rights reserved.
Keywords:
Bayesian learning
kernel methods
logistic regression
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

No organization information available