Premium
A Strategy for Developing a Common Metric in Item Response Theory When Parameter Posterior Distributions Are Known
Author(s) -
Baldwin Peter
Publication year - 2011
Publication title -
journal of educational measurement
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.917
H-Index - 47
eISSN - 1745-3984
pISSN - 0022-0655
DOI - 10.1111/j.1745-3984.2010.00127.x
Subject(s) - metric (unit) , econometrics , statistics , posterior probability , point estimation , item response theory , sampling (signal processing) , overconfidence effect , point (geometry) , mathematics , bayesian probability , model parameter , estimation theory , computer science , psychometrics , psychology , economics , social psychology , operations management , geometry , filter (signal processing) , computer vision
Growing interest in fully Bayesian item response models begs the question: To what extent can model parameter posterior draws enhance existing practices? One practice that has traditionally relied on model parameter point estimates but may be improved by using posterior draws is the development of a common metric for two independently calibrated test forms. Before parameter estimates from independently calibrated forms can be compared, at least one form's estimates must be adjusted such that both forms share a common metric. Because this adjustment is estimated, there is a propagation of error effect when it is applied. This effect is typically ignored, which leads to overconfidence in the adjusted estimates; yet, when model parameter posterior draws are available, it may be accounted for with a simple sampling strategy. In this paper, it is shown using simulated data that the proposed sampling strategy results in adjusted posteriors with superior coverage properties than those obtained using traditional point‐estimate‐based methods.