Premium
Reliability of exercise ratings in the leaderless group discussion
Author(s) -
Gatewood Robert,
Thornton George C.,
Hennessey Harry W.
Publication year - 1990
Publication title -
journal of occupational psychology
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 2.257
H-Index - 114
eISSN - 2044-8325
pISSN - 0305-8107
DOI - 10.1111/j.2044-8325.1990.tb00534.x
Subject(s) - reliability (semiconductor) , psychology , dimension (graph theory) , statistics , applied psychology , social psychology , mathematics , power (physics) , physics , quantum mechanics , pure mathematics
The demonstrated low correlations of dimension ratings across assessment centre exercises has led to reservations about their use. A proposed alternative is the use of overall exercise ratings that may represent total performance on work simulations. Three forms of reliability of such exercise ratings were studied in this laboratory experiment. The study design incorporated four groups of assessors and 31 participants in multiple Leadership Group Discussion (LGD) problems. (LGD was chosen because it is extensively used in assessment centres.) Inter‐rater reliability, as measured by intra‐class correlations within an assessor group, ranged from .69 to .99. Intergroup reliability, as measured by correlations of consensus ratings between assessor groups that had observed identical LGD groups, was .66 to .84. Alternate form reliability, as measured by correlations of overall ratings by the same assessor of participants in two different LGD problems, was .35 to .62. The implications of these findings for the use of overall exercise ratings are discussed.