
TESTING THE UNTESTABLE ASSUMPTIONS OF THE CHAIN AND POSTSTRATIFICATION EQUATING METHODS FOR THE NEAT DESIGN
Author(s) -
Holland Paul W.,
Davier Alina A.,
Sinharay Sandip,
Han Ning
Publication year - 2006
Publication title -
ets research report series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.235
H-Index - 5
ISSN - 2330-8516
DOI - 10.1002/j.2333-8504.2006.tb02023.x
Subject(s) - equating , test (biology) , statistics , mathematics , econometrics , computer science , biology , paleontology , rasch model
This paper focuses on the Non‐Equivalent Groups with Anchor Test (NEAT) design for test equating and on two classes of observed—score equating (OSE) methods—chain equating (CE) and poststratification equating (PSE). These two classes of methods reflect two distinctly different ways of using the information provided by the anchor test for computing OSE functions. Each of the two classes includes linear and nonlinear equating methods. In practical situations, it is known that the PSE and CE methods tend to give different results when the two groups of examinees differ in ability. However, given that both methods are justified by making untestable assumptions, it is difficult to conclude which, if either, of the two equating approaches is more correct. This study compares predictions from both the PSE and the CE assumptions that can be tested in a comparable way with the data from a special study. Results indicate that both CE and PSE make very similar predictions but that those of CE are slightly more accurate than those of PSE.