Premium
Equivalent Pass/Fail Decisions
Author(s) -
Norcini John J.
Publication year - 1990
Publication title -
journal of educational measurement
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.917
H-Index - 47
eISSN - 1745-3984
pISSN - 0022-0655
DOI - 10.1111/j.1745-3984.1990.tb00734.x
Subject(s) - equating , test (biology) , statistics , set (abstract data type) , test score , mathematics , scale (ratio) , standard error , psychology , actuarial science , econometrics , standardized test , computer science , rasch model , paleontology , physics , business , quantum mechanics , biology , programming language
In competency testing, it is sometimes difficult to properly equate scores of different forms of a test and thereby assure equivalent cutting scores. Under such circumstances, it is possible to set standards separately for each test form and then scale the judgments of the standard setters to achieve equivalent pass/fail decisions. Data from standard setters and examinees for a medical certifying examination were reanalyzed. Cutting score equivalents were derived by applying a linear procedure to the standard‐setting results. These were compared against criteria along with the cutting score equivalents derived from typical examination equating procedures. Results indicated that the cutting score equivalents produced by the experts were closer to the criteria than standards derived from examinee performance, especially when the number of examinees used in equating was small. The root mean square error estimate was about 1 item on a 189‐item test.