Premium
The Effects of Coaching on Situational Judgment Tests in High‐stakes Selection
Author(s) -
Lievens Filip,
Buyse Tine,
Sackett Paul R.,
Connelly Brian S.
Publication year - 2012
Publication title -
international journal of selection and assessment
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.812
H-Index - 61
eISSN - 1468-2389
pISSN - 0965-075X
DOI - 10.1111/j.1468-2389.2012.00599.x
Subject(s) - coaching , psychology , covariate , situational ethics , selection (genetic algorithm) , applied psychology , matching (statistics) , propensity score matching , personnel selection , social psychology , statistics , computer science , artificial intelligence , machine learning , mathematics , psychotherapist
Although the evidence for the use of situational judgment tests ( SJTs ) in high‐stakes testing has been generally promising, questions have been raised regarding the potential coachability of SJTs . This study reports the first examination of the effects of coaching on SJT scores in an operational high‐stakes setting. We contrast findings from a simple comparison of SJT scores for coached and uncoached participants (posttest only) with three different approaches to deal with the effects of self‐selection into coaching programs, namely using a pretest as a covariate and using two different forms of propensity score‐based matching using a wide range of variables as covariates. Coaching effects were estimated at about 0.5 SD s . The implications for the use of SJTs in high‐stakes settings and for coaching research in general are discussed.
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom