arrow
Return

Cross-Validation for Correlated Data

delete2020-09-14
delete27
delete
OA
AI
A
Assaf Rabinowicz
S
Saharon Rosset *
DOI:10.1080/01621459.2020.1801451delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
K-fold cross-validation (CV) with squared error loss is widely used for evaluating predictive models, especially when strong distributional assumptions cannot be taken. However, CV with squared error loss is not free from distributional assumptions, in particular in cases involving non-iid data. This article analyzes CV for correlated data. We present a criterion for suitability of standard CV in presence of correlations. When this criterion does not hold, we introduce a bias corrected CV estimator which we termthat yields an unbiased estimate of prediction error in many settings where standard CV is invalid. We also demonstrate our results numerically, and find that introducing our correction substantially improves both, model evaluation and model selection in simulations and real data studies.for this article are available online.
Keywords:
Dependent data
Gaussian process regression
Linear mixed model
Model selection
Prediction error estimation
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

J
Journal of the American Statistical Association
IF:
3
Papers:
5.1K
Citations:
4.8W

Organization

T
Tel Aviv University
Scholars:
3.7W
Papers: 3.0W
Citations: 3.6W