Premium
An applied examination of the computerized adaptive rating scale for assessing performance
Author(s) -
Darr Wendy,
Borman Walter C.,
StPierre Line,
Kubisiak Christean,
Grossman Matthew
Publication year - 2017
Publication title -
international journal of selection and assessment
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.812
H-Index - 61
eISSN - 1468-2389
pISSN - 0965-075X
DOI - 10.1111/ijsa.12167
Subject(s) - psychology , officer , inter rater reliability , applied psychology , rating scale , teamwork , scale (ratio) , reliability (semiconductor) , checklist , flexibility (engineering) , test (biology) , social psychology , statistics , developmental psychology , cognitive psychology , management , power (physics) , physics , mathematics , quantum mechanics , political science , law , economics , paleontology , biology
In the present research, we developed and conducted a field test of the computerized adaptive rating scale (CARS) for assessing military officer performance. Participants completed the CARS and a behaviorally anchored rating scale (BARS) which were both designed to assess five leadership competencies (action orientation/initiative, communication, developing self and others, behavioral flexibility, and teamwork). We obtained data from 116 supervisors and 207 peers who provided ratings on 126 officer ratees. Although interrater reliability estimates were lower for CARS ratings on some competencies, there was a 20–25% improvement in standard error of measurement, the measurement precision in CARS ratings compared to the BARS. Results support findings from a previous lab study.