Premium
Differential Use of Item Information by Judges Using Angoff and Nedeisky Procedures
Author(s) -
Smith Robert L.,
Smith Jeffrey K.
Publication year - 1988
Publication title -
journal of educational measurement
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.917
H-Index - 47
eISSN - 1745-3984
pISSN - 0022-0655
DOI - 10.1111/j.1745-3984.1988.tb00307.x
Subject(s) - variety (cybernetics) , psychology , set (abstract data type) , graduation (instrument) , test (biology) , reading (process) , social psychology , statistics , mathematics education , applied psychology , computer science , mathematics , political science , law , paleontology , geometry , biology , programming language
Competency examinations in a variety of domains require setting a minimum standard of performance. This study examines the issue of whether judges using the two most popular methods for setting cut scores (Angoff and Nedelsky methods) use different sources of information when making their judgments. Thirty‐one judges were assigned randomly to the two methods to set cut scores for a high school graduation test in reading comprehension. These ratings were then related to characteristics of the items as well as to empirically obtained p values. Results indicate that judges using the Angoff method use a wider variety of information and yield estimates closer to the actual p values. The characteristics of items used in the study were effective predictors of judges’ ratings, but were far less effective in predicting p values