Premium
Effects of Organizationally Endorsed Coaching on Performance and Validity of Situational Judgment Tests
Author(s) -
Stemig Melissa S.,
Sackett Paul R.,
Lievens Filip
Publication year - 2015
Publication title -
international journal of selection and assessment
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.812
H-Index - 61
eISSN - 1468-2389
pISSN - 0965-075X
DOI - 10.1111/ijsa.12105
Subject(s) - coaching , psychology , context (archaeology) , situational ethics , applied psychology , test (biology) , construct (python library) , construct validity , social psychology , psychometrics , clinical psychology , psychotherapist , computer science , paleontology , biology , programming language
There is growing interest in organizationally provided or organizationally endorsed coaching. However, little is known about the effects of such coaching on test scores in operational settings. This study reports on an examination of such a program in the context of the use of a situational judgment test ( SJT ) for medical school admissions. We examine the effects of multiple types of coaching methods on SJT scores and on their construct‐related and predictive validities. Results suggest that (1) commercial coaching techniques may not be as effective as previously thought, whereas organizationally provided methods may be more effective, and that (2) the criterion‐related validity of the SJT scores is not degraded by the availability of coaching. Generally, this study illustrates that concerns about potential unfairness of coaching can be countered by making effective coaching available to all examinees, in the form of organizationally endorsed coaching.