Premium
Using word clouds to Re‐envision letters of recommendation for residency applicants
Author(s) -
Bayrak Sinehan B.,
Villwock Jennifer A.,
Villwock Mark R.,
Chiu Alexander G.,
Sykes Kevin J.
Publication year - 2019
Publication title -
the laryngoscope
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.181
H-Index - 148
eISSN - 1531-4995
pISSN - 0023-852X
DOI - 10.1002/lary.27613
Subject(s) - medicine , interquartile range , wilcoxon signed rank test , otorhinolaryngology , family medicine , surgery , mann–whitney u test
Objectives/Hypothesis To develop a “word cloud”–based visual letter of recommendation (VLOR) and to evaluate its efficiency in discerning applicant quality compared to narrative letters of recommendation (NLORs). Study Design Cross‐sectional cohort study. Methods NLORs for 48 otolaryngology residency applicants interviewed from the 2016 application cycle were identified and mined for descriptive terms to generate a word cloud, referred to as a VLOR. Eight individuals reviewed and rated a total of 187 blinded NLORs and 48 VLORs on a four‐point scale (negative to exceptional). Median VLOR and NLOR scores and the time to review for each candidate were compared using the Wilcoxon signed rank test. Results It took significantly more time to review the NLORs in comparison to the VLORs (67 seconds, interquartile range [IQR]: 41–98 seconds vs. 17 seconds, IQR: 11–26 seconds, P < .001). There was no significant difference between median scores for VLORs and NLORs ( P = .136). Review time and score correlated positively for VLORs and was statistically significant (ρ = 0.459, P = .001), indicating that more time spent reviewing equates to higher scores. The same relationship appeared with NLORs, but was not statistically significant (ρ = 0.276, P = .058). Conclusions VLORs are a novel and efficient additive tool for screening candidates for otolaryngology residency interview slots. Their scores do not significantly vary from NLOR scores and are significantly faster to evaluate. Level of Evidence 2b Laryngoscope , 129:2026–2030, 2019