Premium
An Investigation of Classification Consistency Indexes Estimated Under Alternative Strong True Score Models
Author(s) -
Hanson Bradley A.,
Brennan Robert L.
Publication year - 1990
Publication title -
journal of educational measurement
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.917
H-Index - 47
eISSN - 1745-3984
pISSN - 0022-0655
DOI - 10.1111/j.1745-3984.1990.tb00753.x
Subject(s) - consistency (knowledge bases) , statistics , beta binomial distribution , mathematics , binomial (polynomial) , binomial distribution , econometrics , negative binomial distribution , geometry , poisson distribution
Using several data sets, the authors examine the relative performance of the beta binomial model and two other more general strong true score models in estimating several indexes of classification consistency. It is shown that the beta binomial model can provide inadequate fits to raw score distributions compared to more general models. This lack of fit is reflected in differences in decision consistency indexes computed using the beta binomial model and the other models. It is recommended that the adequacy of a model in fitting the data be assessed before the model is used to estimate decision consistency indexes. When the beta binomial model does not fit the data, the more general models discussed here may provide an adequate fit and, in such cases, would be more appropriate for computing decision consistency indexes.