Premium
Interrater Reliability of the OPI: Using Academic Trainee Raters
Author(s) -
Halleck Gene B.
Publication year - 1996
Publication title -
foreign language annals
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.258
H-Index - 49
eISSN - 1944-9720
pISSN - 0015-718X
DOI - 10.1111/j.1944-9720.1996.tb02329.x
Subject(s) - inter rater reliability , psychology , reliability (semiconductor) , graduate students , certification , clinical psychology , medical education , pedagogy , developmental psychology , rating scale , medicine , power (physics) , physics , quantum mechanics , political science , law
The purpose of this study was to investigate the interrater reliability of proficiency level judgments of graduate student trainee raters on Oral Proficiency Interviews (OPIs). Trainees' ratings were compared with the judgments of a certified ACTFL tester for 150 interviews. In addition to reporting correlation coefficients, this study analyzes the relationship between proficiency level and its effect on interrater reliability. The data indicate that Superior and Intermediate Mid interviews resulted in the highest level of interrater reliability, while Advanced High, Advanced, and Intermediate High interviews were more difficult for the trainee raters to judge.