Open AccessUse of Jackknifing to Evaluate Effects of Anchor Item Selection on Equating With the Nonequivalent Groups With Anchor Test (NEAT) Design
Author(s) -
Lu Ru,
Haberman Shelby,
Guo Hongwen,
Liu Jinghua
Publication year - 2015
Publication title -
ets research report series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.235
H-Index - 5
ISSN - 2330-8516
DOI - 10.1002/ets2.12056
Subject(s) - equating , selection (genetic algorithm) , statistics , test (biology) , econometrics , mathematics , item response theory , sample (material) , stability (learning theory) , psychology , computer science , artificial intelligence , psychometrics , machine learning , rasch model , paleontology , biology , chemistry , chromatography
In this study, we apply jackknifing to anchor items to evaluate the impact of anchor selection on equating stability. In an ideal world, the choice of anchor items should have little impact on equating results. When this ideal does not correspond to reality, selection of anchor items can strongly influence equating results. This influence does not disappear even if large examinee samples are present. Consequently, it provides a major hazard in practical use of equating. Although the effect of anchor selection does not disappear with increasing sample size, it is reasonable to expect smaller effects with test anchors with more items. To illustrate results, two examples of real equating data were evaluated using two classical equating methods. The results show that rather large effects may be associated with sampling of anchor items.