Premium
Dimensionality, bias, independence and measurement scale problems in latent trait test score models
Author(s) -
Goldstein Harvey
Publication year - 1980
Publication title -
british journal of mathematical and statistical psychology
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 3.157
H-Index - 51
eISSN - 2044-8317
pISSN - 0007-1102
DOI - 10.1111/j.2044-8317.1980.tb00610.x
Subject(s) - rasch model , local independence , curse of dimensionality , econometrics , item response theory , polytomous rasch model , trait , independence (probability theory) , scale (ratio) , test (biology) , latent variable model , statistics , mathematics , latent variable , psychology , computer science , psychometrics , paleontology , physics , quantum mechanics , biology , programming language
It is argued that latent trait models used in the analysis of test scores, in particular the Rasch model, suffer from serious defects. They assume implicitly a measurement scale model for which little substantive justification seems to be available and they make the assumption of ‘local independence’ which enjoys little empirical support. Perhaps their most serious drawback, which is illustrated with the fixed effects' Rasch model, is that the individual ability estimates obtained are always biased. This bias is not constant but depends upon an individual's true ability, the number of items in the test and their difficulty values. Moreover, there is no way to obtain an unbiased estimate in the typical case when only one administration of a test is given to individuals. This result suggests that the use of such models needs to be critically examined, especially in connection with so‐called ‘item banks’. The paper also discusses the dimensionality of the latent space, and shows how multidimensional models may be specified.