Premium
On the Optimality of Prediction‐based Selection Criteria and the Convergence Rates of Estimators
Author(s) -
Altman Naomi,
Léger Christian
Publication year - 1997
Publication title -
journal of the royal statistical society: series b (statistical methodology)
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 6.523
H-Index - 137
eISSN - 1467-9868
pISSN - 1369-7412
DOI - 10.1111/1467-9868.00064
Subject(s) - estimator , mathematics , asymptotically optimal algorithm , residual , mean squared error , rate of convergence , cross validation , selection (genetic algorithm) , smoothing , mathematical optimization , statistics , differentiable function , convergence (economics) , model selection , nonparametric statistics , computer science , algorithm , computer network , channel (broadcasting) , mathematical analysis , artificial intelligence , economics , economic growth
Several estimators of squared prediction error have been suggested for use in model and bandwidth selection problems. Among these are cross‐validation, generalized cross‐validation and a number of related techniques based on the residual sum of squares. For many situations with squared error loss, e.g. nonparametric smoothing, these estimators have been shown to be asymptotically optimal in the sense that in large samples the estimator minimizing the selection criterion also minimizes squared error loss. However, cross‐validation is known not to be asymptotically optimal for some `easy' location problems. We consider selection criteria based on estimators of squared prediction risk for choosing between location estimators. We show that criteria based on adjusted residual sum of squares are not asymptotically optimal for choosing between asymptotically normal location estimators that converge at rate n 1/2 but are when the rate of convergence is slower. We also show that leave‐one‐out cross‐validation is not asymptotically optimal for choosing between √ n ‐differentiable statistics but leave‐ d ‐out cross‐validation is optimal when d ∞ at the appropriate rate.