Premium
An Examination of Common Sensitivity Review Practices in Test Development
Author(s) -
Golubovich Juliya,
Grand James A.,
Ryan Ann Marie,
Schmitt Neal
Publication year - 2014
Publication title -
international journal of selection and assessment
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.812
H-Index - 61
eISSN - 1468-2389
pISSN - 0965-075X
DOI - 10.1111/ijsa.12052
Subject(s) - psychology , sensitivity (control systems) , test (biology) , applied psychology , social psychology , paleontology , electronic engineering , engineering , biology
Sensitivity reviews of test content are commonly advocated techniques for reducing bias and enhancing fairness in employment and educational testing. However, few descriptions or empirical investigations of these techniques exist. The present paper presents a study documenting common sensitivity review practices and the extent to which expert reviewers agree in their judgments of item sensitivity. Results indicated that reviewers do not always receive training or adequate guidance and most frequently encounter subtle forms of insensitive item content. Further, only modest agreement in expert ratings of item sensitivity was found. Implications for improving sensitivity review practices are presented.