arrow
Return

Model selection for small sample regression

delete2002-01-01
delete100
delete
OA
AI
O
Olivier Chapelle *
V
Vapnik, V
Y
Yoshua Bengio
DOI:10.1023/A:1013943418833delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Model selection is an important ingredient of many machine learning algorithms, in particular when the sample size in small, in order to strike the right trade-off between overfitting and underfitting. Previous classical results for linear regression are based on an asymptotic analysis. We present a new penalization method for performing model selection for regression that is appropriate even for small samples. Our penalization is based on an accurate estimator of the ratio of the expected training error and the expected generalization error, in terms of the expected eigenvalues of the input covariance matrix.
Keywords:
model selection
parametric regression
uniform convergence bounds
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.6K
Citations:
3.4W

Organization

No organization information available