Premium
The Council of Emergency Medicine Residency Directors Speaker Evaluation Form for Medical Conference Planners
Author(s) -
Phillips Andrew W.,
Diller David,
Williams Sarah,
Park Yoon Soo,
Fisher Jonathan,
Biese Kevin,
Ufberg Jacob
Publication year - 2017
Publication title -
aem education and training
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.49
H-Index - 9
ISSN - 2472-5390
DOI - 10.1002/aet2.10051
Subject(s) - summative assessment , cronbach's alpha , context (archaeology) , psychology , consistency (knowledge bases) , reliability (semiconductor) , medical education , toolbox , computer science , formative assessment , medicine , pedagogy , artificial intelligence , paleontology , programming language , psychometrics , clinical psychology , power (physics) , physics , quantum mechanics , biology
Objectives No summative speaker evaluation form with validity and reliability evidence currently exists in the English medical education literature specifically to help conference planners make future decisions on speakers. We seek to perform a proof‐of‐concept evaluation of a concise, effective evaluation form to be filled out by audience members to aid conference planners. Methods We created the Council of Emergency Medicine Residency Directors ( CORD ‐ EM ) form, a novel, three‐question speaker evaluation form for the CORD ‐ EM national conference and evaluated it for proof of concept. The CORD ‐ EM form was analyzed with three evaluators and randomized to select only two evaluators’ ratings to make results more generalizable to a generic audience evaluating the speaker. Results Forty‐six total evaluations ranged from 6 to 9 (mean ± standard deviation = 8.1 ± 1.2). The form demonstrated excellent internal consistency (Cronbach's alpha = 0.923) with good inter‐rater reliability (intraclass correlation = 0.617) in the conference context. Conclusions The CORD ‐ EM speaker evaluation form is, to our knowledge, the first evaluation form with early reliability and validity evidence specifically designed to help conference planners. Our results suggest that a short speaker evaluation form can be an effective instrument in the toolbox for conference planners.