Premium
Choosing a Model Selection Strategy
Author(s) -
DE LUNA XAVIER,
SKOURAS KOSTAS
Publication year - 2003
Publication title -
scandinavian journal of statistics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.359
H-Index - 65
eISSN - 1467-9469
pISSN - 0303-6898
DOI - 10.1111/1467-9469.00321
Subject(s) - model selection , selection (genetic algorithm) , mathematics , sample (material) , sample size determination , identification (biology) , base (topology) , information criteria , data mining , computer science , machine learning , statistics , chemistry , mathematical analysis , botany , chromatography , biology
An important problem in statistical practice is the selection of a suitable statistical model. Several model selection strategies are available in the literature, having different asymptotic and small sample properties, depending on the characteristics of the data generating mechanism. These characteristics are difficult to check in practice and there is a need for a data‐driven adaptive procedure to identify an appropriate model selection strategy for the data at hand. We call such an identification a model metaselection, and we base it on the analysis of recursive prediction residuals obtained from each strategy with increasing sample sizes. Graphical tools are proposed in order to study these recursive residuals. Their use is illustrated on real and simulated data sets. When necessary, an automatic metaselection can be performed by simply accumulating predictive losses. Asymptotic and small sample results are presented.