Conditional predictive inference post model selection
Abstract
We give a finitesample analysis of predictive inference procedures after model selection in regression with random design. The analysis is focused on a statistically challenging scenario where the number of potentially important explanatory variables can be infinite, where no regularity conditions are imposed on unknown parameters, where the number of explanatory variables in a "good" model can be of the same order as sample size and where the number of candidate models can be of larger order than sample size. The performance of inference procedures is evaluated conditional on the training sample. Under weak conditions on only the number of candidate models and on their complexity, and uniformly over all datagenerating processes under consideration, we show that a certain prediction interval is approximately valid and short with high probability in finite samples, in the sense that its actual coverage probability is close to the nominal one and in the sense that its length is close to the length of an infeasible interval that is constructed by actually knowing the "best" candidate model. Similar results are shown to hold for predictive inference procedures other than prediction intervals like, for example, tests of whether a future response will lie above or below a given threshold.
 Publication:

arXiv eprints
 Pub Date:
 August 2009
 DOI:
 10.48550/arXiv.0908.3615
 arXiv:
 arXiv:0908.3615
 Bibcode:
 2009arXiv0908.3615L
 Keywords:

 Mathematics  Statistics;
 62G15 (Primary;
 ) 62H12;
 62J05;
 62J07 (Secondary)
 EPrint:
 Published in at http://dx.doi.org/10.1214/08AOS660 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)