arrow
返回

Model selection for linear classifiers using Bayesian error estimation

delete2015-11-01
delete14
PRE
AI
H
Heikki Huttunen *
J
Jussi Tohka
DOI:10.1016/j.patcog.2015.05.005delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Regularized linear models are important classification methods for high dimensional problems, where regularized linear classifiers are often preferred due to their ability to avoid overfitting. The degree of freedom of the model dis determined by a regularization parameter, which is typically selected using counting based approaches, such as K-fold cross-validation. For large data, this can be very time consuming, and, for small sample sizes, the accuracy of the model selection is limited by the large variance of CV error estimates. In this paper, we study the applicability of a recently proposed Bayesian error estimator for the selection of the best model along the regularization path. We also propose an extension of the estimator that allows model selection in multiclass cases and study its efficiency with L-1 regularized logistic regression and L-2 regularized linear support vector machine. The model selection by the new Bayesian error estimator is experimentally shown to improve the classification accuracy, especially in small sample-size situations, and is able to avoid the excess variability inherent to traditional cross-validation approaches. Moreover, the method has significantly smaller computational complexity than cross-validation. (C) 2015 Elsevier Ltd. All rights reserved.
Keyword:
Logistic regression
Support vector machine
Regularization
Bayesian error estimator
Linear classifier
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

U
Universidad Carlos III de Madrid
学者数:
5.5K
论文数: 5.7K
被引数: 4.5K
T
Tampere University
学者数:
1.4W
论文数: 1.3W
被引数: 1.4W
引用论文

引用论文

Synthesis and structure-activity studies of SH2 binding peptides containing hydrolytically stable analogs of O -phosphotyrosine
err1994-01-01
err0
PREAI
errA. Otaka; M. Nomizu; M. S. Smyth; S. E. Shoelson; R. D. Case; T. R. Burke; P. P. Roller
err分享
err收藏
The electroneutrality approximation in electrochemistry电化学中的电中性近似
err2011-02-22
err0
PREAI
errEdmund J. F. Dickinson; Juan G. Limon-Petersen; Richard G. Compton
err分享
err收藏
err分享
err收藏
High-resolution serum proteomic features for ovarian cancer detection
err2004-06-01
err220
errOAAI
errConrads, TP; Fusaro, VA; Ross, S; Johann, D; Rajapakse, V; Hitt, BA; Steinberg, SM; Kohn, EC; Fishman, DA; Whiteley, G; Barrett, JC; Liotta, LA; Petricoin, EF; Veenstra, TD
err分享
err收藏
Choosing multiple parameters for support vector machines
err2002-01-01
err2.0K
errOAAI
errChapelle, O; Vapnik, V; Bousquet, O; Mukherjee, S
err分享
err收藏
学者 查看更多内容