Open AccessVariability in Percentage Above Cut Scores Due to Discreteness in Score Scale
Author(s) -
Lu Ying
Publication year - 2017
Publication title -
ets research report series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.235
H-Index - 5
ISSN - 2330-8516
DOI - 10.1002/ets2.12158
Subject(s) - statistics , scale (ratio) , test score , affect (linguistics) , psychology , test (biology) , item response theory , standard score , econometrics , mathematics , psychometrics , standardized test , paleontology , physics , communication , quantum mechanics , biology
For standard‐ or criterion‐based assessments, the use of cut scores to indicate mastery, nonmastery, or different levels of skill mastery is very common. As part of performance summary, it is of interest to examine the percentage of examinees at or above the cut scores ( PAC ) and how PAC evolves across administrations. This paper shows that discreteness in score scales can affect the PAC statistics considerably, especially when the test is short and when there are high examinee density and low item density near the cut score on the reporting score scale. This paper also includes recommendations on how to adjust the PAC statistics when they are used in trend analyses.