Premium
Rater training revisited: An updated meta‐analytic review of frame‐of‐reference training
Author(s) -
Roch Sylvia G.,
Woehr David J.,
Mishra Vipanchi,
Kieszczynska Urszula
Publication year - 2012
Publication title -
journal of occupational and organizational psychology
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 2.257
H-Index - 114
eISSN - 2044-8325
pISSN - 0963-1798
DOI - 10.1111/j.2044-8325.2011.02045.x
Subject(s) - meta analysis , snapshot (computer storage) , psychology , frame of reference , training (meteorology) , applied psychology , cognitive psychology , computer science , medicine , physics , quantum mechanics , meteorology , operating system
The present study updates Woehr and Huffcutt's (1994) rater training meta‐analysis and demonstrates that frame‐of‐reference (FOR) training is an effective method of improving rating accuracy. The current meta‐analysis includes over four times as many studies as included in the Woehr and Huffcutt meta‐analysis and also provides a snapshot of current rater training studies. The present meta‐analysis also extends the previous meta‐analysis by showing that not all operationalizations of accuracy are equally improved by FOR training; Borman's differential accuracy appears to be the most improved by FOR training, along with behavioural accuracy, which provides a snapshot into the cognitive processes of the raters. We also investigate the extent to which FOR training protocols differ, the implications of protocol differences, and if the criteria of interest to FOR researchers have changed over time.