Premium
Reliability of the Welling Scale (WS1) for Rating Temporal Bone Dissection Performance
Author(s) -
Butler Nancy N.,
Wiet Gregory J.
Publication year - 2007
Publication title -
the laryngoscope
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.181
H-Index - 148
eISSN - 1531-4995
pISSN - 0023-852X
DOI - 10.1097/mlg.0b013e31811edd7a
Subject(s) - reliability (semiconductor) , computer science , dissection (medical) , scale (ratio) , rating scale , reliability engineering , engineering , medicine , psychology , power (physics) , physics , anatomy , cartography , developmental psychology , geography , quantum mechanics
Objective: To determine the inter‐ and intrarater reliability of using a new scale (Welling scale) for resident evaluation of temporal bone dissection performance. Study Design: Prospective, double‐blinded, randomized trial. Methods: Twelve residents in otolaryngology (postgraduate year [PGY] 2–5) drilled 26 temporal bones (21 cadaveric, 5 plastic) with the objective to perform a complete mastoidectomy with facial recess approach. These bones were then rated using the Welling scale by six independent raters on two separate occasions (4–6 wk apart). Raters were blinded to PGY year. The Kappa statistic was calculated for inter‐ and intrarater reliability. Results: Intrarater agreement was high for all raters, ranging from κ = 0.65 to 0.72 (all P < .001), whereas the interrater agreement scores were more moderate (range, κ = 0.49–0.64; all P < .01). Conclusion: The Welling scale can be used reliably to assess temporal bone dissection performance where performance is measured by assessment of end product (mastoidectomy with facial recess approach).