Premium
DIC in variable selection
Author(s) -
Linde Angelika
Publication year - 2005
Publication title -
statistica neerlandica
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.52
H-Index - 39
eISSN - 1467-9574
pISSN - 0039-0402
DOI - 10.1111/j.1467-9574.2005.00278.x
Subject(s) - model selection , selection (genetic algorithm) , entropy (arrow of time) , feature selection , mathematics , variable (mathematics) , computer science , statistics , artificial intelligence , mathematical analysis , quantum mechanics , physics
Model comparison is discussed from an information theoretic point of view. In particular the posterior predictive entropy is related to the target yielding DIC and modifications thereof. The adequacy of criteria for posterior predictive model comparison is also investigated depending on the comparison to be made. In particular variable selection as a special problem of model choice is formalized in different ways according to whether the comparison is a comparison across models or within an encompassing model and whether a joint or conditional sampling scheme is applied. DIC has been devised for comparisons across models. Its use in variable selection and that of other criteria is illustrated for a simulated data set.