A new look at within-source interrater reliability of 360-degree feedback ratings. | Zendy

Gary J. Greguras | Zendy; Chet Robie | Zendy

AI Assistant Blog Pricing

Home ZAIA Blog

Open Access

A new look at within-source interrater reliability of 360-degree feedback ratings.

Author(s) -

Gary J. Greguras,

Chet Robie

Publication year - 1998

Publication title -

journal of applied psychology

Language(s) - English

Resource type - Journals

SCImago Journal Rank - 6.522

H-Index - 284

eISSN - 1939-1854

pISSN - 0021-9010

DOI - 10.1037/0021-9010.83.6.960

Subject(s) - inter rater reliability , psychology , reliability (semiconductor) , degree (music) , social psychology , statistics , applied psychology , rating scale , developmental psychology , mathematics , power (physics) , physics , quantum mechanics , acoustics

This study investigated within-source interrater reliability of supervisor, peer, and subordinate feedback ratings made for managerial development. Raters provided 360-degree feedback ratings on a sample of 153 managers. Using generalizability theory, results indicated that little within-source agreement exists; a large portion of the error variance is attributable to the combined rater main effect and Rater X Ratee effect; more raters are needed than currently used to reach acceptable levels of reliability; supervisors are the most reliable with trivial differences between peers and subordinates when the numbers of raters and items are held constant; and peers are the most reliable, followed by subordinates, followed by supervisors, under conditions commonly encountered in practice. Implications for the validity, design, and maintenance of 360-degree feedback systems are discussed along with directions for future research in this area

The content you want is available to Zendy users.

Already have an account? Click here to sign in.

Having issues? You can contact us here

Accelerating Research