Premium
Content Specificity of Expert Judgments in a Standard‐Setting Study
Author(s) -
Plake Barbara S.,
Impara James C.,
Potenza Maria T.
Publication year - 1994
Publication title -
journal of educational measurement
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.917
H-Index - 47
eISSN - 1745-3984
pISSN - 0022-0655
DOI - 10.1111/j.1745-3984.1994.tb00451.x
Subject(s) - comparability , psychology , content (measure theory) , test (biology) , content validity , content analysis , set (abstract data type) , medical education , mathematics education , psychometrics , medicine , computer science , clinical psychology , mathematics , combinatorics , sociology , biology , programming language , mathematical analysis , paleontology , social science
This study investigated the comparability of Angoff‐based item ratings on a general education test battery made by judges from within‐content specialties and across content domains. Judges were from English, mathematics, science, and social studies specialties in teacher education programs in a midwestem state. Cutscores established from the judges’ratings of out‐of‐content items differed little from the cutscores set using the ratings made by the content specialists. Further, out‐of‐content ratings by judges were not more influenced by performance data than were the ratings provided by judges rating items within their content specialty. The degree to ‐which these results generalize to other content specialties needs to be investigated.