arrow
返回

Efficient approximate leave-one-out cross-validation for kernel logistic regression

delete2008-04-17
delete69
delete
OA
AI
G
Gavin C. Cawley *
N
Nicola L. C. Talbot
DOI:10.1007/s10994-008-5055-9delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Kernel logistic regression (KLR) is the kernel learning method best suited to binary pattern recognition problems where estimates of a-posteriori probability of class membership are required. Such problems occur frequently in practical applications, for instance because the operational prior class probabilities or equivalently the relative misclassification costs are variable or unknown at the time of training the model. The model parameters are given by the solution of a convex optimization problem, which may be found via an efficient iteratively re-weighted least squares (IRWLS) procedure. The generalization properties of a kernel logistic regression machine are however governed by a small number of hyper-parameters, the values of which must be determined during the process of model selection. In this paper, we propose a novel model selection strategy for KLR, based on a computationally efficient closed-form approximation of the leave-one-out cross-validation procedure. Results obtained on a variety of synthetic and real-world benchmark datasets are given, demonstrating that the proposed model selection procedure is competitive with a more conventional k-fold cross-validation based approach and also with Gaussian process (GP) classifiers implemented using the Laplace approximation and via the Expectation Propagation (EP) algorithm.
Keyword:
model selection
Kernel logistic regression

期刊

Machine Learning 封面图
Machine Learning
IF:
2.9
论文数:
2.7K
被引数:
3.4W

机构

U
University of East Anglia
学者数:
9.6K
论文数: 1.0W
被引数: 1.8W
引用论文

引用论文

Lymphomatoid Granulomatosis
err2000-11-01
err0
PREAI
errJin Seong Lee; Rubin Tuder; David A. Lynch
err分享
err收藏
Giant pyroelectricity in nanomembranes纳米膜中的巨热电性
err2022-07-20
err0
PREAI
errJie Jiang; Lifu Zhang; Chen Ming; Hua Zhou; Pritom Bose; Yuwei Guo; Yang Hu; Baiwei Wang; Zhizhong Chen; Ru Jia; Saloni Pendse; Yu Xiang; Yaobiao Xia; Zonghuan Lu; Xixing Wen; Yao Cai; Chengliang Sun; Gwo-Ching Wang; Toh-Ming Lu; Daniel Gall; Yi-Yang Sun; Nikhil Koratkar; Edwin Fohtung; Yunfeng Shi; Jian Shi
err分享
err收藏
err分享
err收藏
Synthesis of Mesoporous SiO2@TiO2 Core/Shell Nanospheres with Enhanced Photocatalytic Properties
err2013-02-08
err0
PREAI
errJin‐Lin Hu; Hai‐Sheng Qian; Jia‐Jia Li; Yong Hu; Zheng‐Quan Li; Shu‐Hong Yu
err分享
err收藏
Weighted least squares support vector machines: robustness and sparse approximation
err2002-10-01
err1.3K
errOAAI
errSuykens, JAK; De Brabanter, J; Lukas, L; Vandewalle, J
err分享
err收藏
Principles of Drying
err2014-10-31
err0
PREAI
errRaúl Grau; Ana Andres; José M. Barat
err分享
err收藏
学者 查看更多内容