Premium
Supervisory opportunity to observe moderates criterion‐related validity estimates
Author(s) -
MacLane Charles N.,
Cucina Jeffrey M.,
Busciglio Henry H.,
Su Chihwei
Publication year - 2020
Publication title -
international journal of selection and assessment
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.812
H-Index - 61
eISSN - 1468-2389
pISSN - 0965-075X
DOI - 10.1111/ijsa.12267
Subject(s) - psychology , moderation , supervisor , test (biology) , social psychology , criterion validity , external validity , applied psychology , clinical psychology , management , psychometrics , construct validity , economics , paleontology , biology
Supervisors' opportunity to observe incumbents' performance (i.e., how often a supervisor typically sees an employee's performance) has been suggested to be important for accurate performance rating and to be a moderator of criterion‐related validity. Here we test these suggestions and present empirical evidence for the effects of opportunity to observe. In Study 1, supervisors in a multi‐occupation/organization criterion‐related validation study for a biodata measure indicated the opportunity they had to observe incumbents. The data were split according to different levels of opportunity to observe. Higher validities were found when opportunity to observe was maximal. In Study 2, this finding was replicated using a cognitive ability test. These results suggest that psychologists should consider measuring opportunity to observe in criterion‐related validity studies.