返回
Efficient approximate leave-one-out cross-validation for kernel logistic regression
DOI:10.1007/s10994-008-5055-9.png)
摘要
En 中文
Kernel logistic regression (KLR) is the kernel learning method best suited to binary pattern recognition problems where estimates of a-posteriori probability of class membership are required. Such problems occur frequently in practical applications, for instance because the operational prior class probabilities or equivalently the relative misclassification costs are variable or unknown at the time of training the model. The model parameters are given by the solution of a convex optimization problem, which may be found via an efficient iteratively re-weighted least squares (IRWLS) procedure. The generalization properties of a kernel logistic regression machine are however governed by a small number of hyper-parameters, the values of which must be determined during the process of model selection. In this paper, we propose a novel model selection strategy for KLR, based on a computationally efficient closed-form approximation of the leave-one-out cross-validation procedure. Results obtained on a variety of synthetic and real-world benchmark datasets are given, demonstrating that the proposed model selection procedure is competitive with a more conventional k-fold cross-validation based approach and also with Gaussian process (GP) classifiers implemented using the Laplace approximation and via the Expectation Propagation (EP) algorithm.
Keyword:
model selection
Kernel logistic regression
期刊
IF:
2.9
论文数:
2.7K
被引数:
3.4W
机构
引用论文
Fast exact leave-one-out cross-validation of sparse least-squares support vector machines稀疏最小二乘支持向量机的快速精确留一交叉验证
NEURAL NETWORKS
IF6.3
Weighted least squares support vector machines: robustness and sparse approximation
NEUROCOMPUTING
IF6.5

