arrow
Return

CONDITIONAL PREDICTIVE INFERENCE POST MODEL SELECTION

delete2009-10-01
delete26
delete
OA
AI
H
Hannes Leeb *
DOI:10.1214/08-AOS660delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We give a finite-sample analysis of predictive inference procedures after model selection in regression with random design. The analysis is focused on a statistically challenging scenario where the number of potentially important explanatory variables can be infinite, where no regularity conditions are imposed on unknown parameters, where the number of explanatory variables in a good model can be of the same order as sample size and where the number of candidate models can be of larger order than sample size. The performance of inference procedures is evaluated conditional on the training sample. Under weak conditions on only the number of candidate models and on their complexity, and uniformly over all data-generating processes under consideration, we show that a certain prediction interval is approximately valid and short with high probability in finite samples, in the sense that its actual coverage probability is close to the nominal one and in the sense that its length is close to the length of an infeasible interval that is constructed by actually knowing the best candidate model. Similar results are shown to hold for predictive inference procedures other than prediction intervals like, for example, tests of whether a future response will lie above of below a given threshold.
Keywords:
Predictive inference post model selection
regression with random design
conditional coverage probability
finite sample analysis
approximately honest and short prediction interval

Journal

Annals of Statistics cover
Annals of Statistics
IF:
3.7
Papers:
2.8K
Citations:
2.9W

Organization

No organization information available
Cited Papers

Cited Papers

errShare
errSave
Local structural change in GaCrN grown by radio frequency plasma-assisted molecular-beam epitaxy
err2004-12-01
err0
PREAI
errM. Hashimoto; H. Tanaka; S. Emura; M.S. Kim; T. Honma; N. Umesaki; Y.K. Zhou; S. Hasegawa; H. Asahi
errShare
errSave
errShare
errSave
Adaptive confidence balls
err2006-02-01
err54
errOAAI
errCai, TT; Low, MG
errShare
errSave
Adaptive nonparametric confidence sets
err2006-02-01
err60
errOAAI
errRobins, James; Van der Vaart, Aad
errShare
errSave
Phase equilibria of (water+levulinic acid+dibasic esters) ternary systems
err2009-08-01
err0
PREAI
errHasan Uslu; Aslı Gök; Ş. İsmail Kırbaşlar
errShare
errSave
A gene-expression signature as a predictor of survival in breast cancer.
err2002-12-19
err5.5K
errOAAI
errvan de Vijver, MJ; He, YD; van 't Veer, LJ; Dai, H; Hart, AAM; Voskuil, DW; Schreiber, GJ; Peterse, JL; Roberts, C; Marton, MJ; Parrish, M; Atsma, D; Witteveen, A; Glas, A; Delahaye, L; van der Velde, T; Bartelink, H; Rodenhuis, S; Rutgers, ET; Friend, SH; Bernards, R
errShare
errSave
errShare
errSave
Random rates in anisotropic regression
err2002-04-01
err57
errOAAI
errHoffmann, M; Lepski, O
errShare
errSave
researcher View more