Open AccessSCALE DRIFT IN EQUATING ON A TEST THAT EMPLOYS CUT SCORES
Author(s) -
Puhan Gautam
Publication year - 2007
Publication title -
ets research report series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.235
H-Index - 5
ISSN - 2330-8516
DOI - 10.1002/j.2333-8504.2007.tb02076.x
Subject(s) - equating , scale (ratio) , statistics , test score , mathematics , econometrics , point (geometry) , stability (learning theory) , test (biology) , computer science , rasch model , standardized test , machine learning , biology , paleontology , physics , geometry , quantum mechanics
The purpose of this study is to determine the extent of scale drift on a test that employs cut scores. It is essential to examine scale drift in a testing program using new forms that are often put on scale through a series of intermediate equatings (known as equating chains). This may cause equating error to accumulate to a point where scale scores are rendered incomparable across two parallel chains or time periods. The study examined whether scale drift occurred for two conditions (i.e., parallel equating chains and a single long chain). Data from three tests that employed cut scores were used in this study. Results indicated that although there was some difference observed between the actual equating conversions derived via different equating chains, the effect of these differences on actual pass/fail status of test takers was not large. However, these results may change if new cut scores are introduced. Also, for tests that do not employ cut scores, stability in most parts of the score scale is important, not just at particular cut score points.