Premium
How effective are selection methods in medical education? A systematic review
Author(s) -
Patterson Fiona,
Knight Alec,
Dowell Jon,
Nicholson Sandra,
Cousans Fran,
Cleland Jennifer
Publication year - 2016
Publication title -
medical education
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.776
H-Index - 138
eISSN - 1365-2923
pISSN - 0308-0110
DOI - 10.1111/medu.12817
Subject(s) - psychology , selection (genetic algorithm) , aptitude , context (archaeology) , situational ethics , personnel selection , medical education , applied psychology , personality , social psychology , medicine , computer science , developmental psychology , statistics , mathematics , paleontology , artificial intelligence , biology
Context Selection methods used by medical schools should reliably identify whether candidates are likely to be successful in medical training and ultimately become competent clinicians. However, there is little consensus regarding methods that reliably evaluate non‐academic attributes, and longitudinal studies examining predictors of success after qualification are insufficient. This systematic review synthesises the extant research evidence on the relative strengths of various selection methods. We offer a research agenda and identify key considerations to inform policy and practice in the next 50 years. Methods A formalised literature search was conducted for studies published between 1997 and 2015. A total of 194 articles met the inclusion criteria and were appraised in relation to: (i) selection method used; (ii) research question(s) addressed, and (iii) type of study design. Results Eight selection methods were identified: (i) aptitude tests; (ii) academic records; (iii) personal statements; (iv) references; (v) situational judgement tests ( SJT s); (vi) personality and emotional intelligence assessments; (vii) interviews and multiple mini‐interviews ( MMI s), and (viii) selection centres ( SC s). The evidence relating to each method was reviewed against four evaluation criteria: effectiveness (reliability and validity); procedural issues; acceptability, and cost‐effectiveness. Conclusions Evidence shows clearly that academic records, MMI s, aptitude tests, SJT s and SC s are more effective selection methods and are generally fairer than traditional interviews, references and personal statements. However, achievement in different selection methods may differentially predict performance at the various stages of medical education and clinical practice. Research into selection has been over‐reliant on cross‐sectional study designs and has tended to focus on reliability estimates rather than validity as an indicator of quality. A comprehensive framework of outcome criteria should be developed to allow researchers to interpret empirical evidence and compare selection methods fairly. This review highlights gaps in evidence for the combination of selection tools that is most effective and the weighting to be given to each tool.