Premium
Evaluation of the prototype Anaesthetic Non‐technical Skills for Anaesthetic Practitioners ( ANTS ‐ AP ) system: a behavioural rating system to assess the non‐technical skills used by staff assisting the anaesthetist
Author(s) -
Rutherford J. S.,
Flin R.,
Irwin A.,
McFadyen A. K.
Publication year - 2015
Publication title -
anaesthesia
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.839
H-Index - 117
eISSN - 1365-2044
pISSN - 0003-2409
DOI - 10.1111/anae.13127
Subject(s) - medicine , cronbach's alpha , reliability (semiconductor) , intraclass correlation , test (biology) , teamwork , medical education , psychometrics , clinical psychology , paleontology , power (physics) , physics , quantum mechanics , political science , law , biology
Summary This study tested the reliability, validity and usability of a prototype behavioural rating system for the non‐technical skills of assistants working with the anaesthetist. Anaesthetic nurses and operating department practitioners (n = 48) used the prototype Anaesthetic Non‐technical Skills for Anaesthetic Practitioners ( ANTS ‐ AP ) system to rate the non‐technical skills of anaesthetic assistants in 12 videos of simulated theatre work. Test–retest reliability was assessed with a sub‐sample (n = 12). The skill categories assessed were ‘situation awareness’, ‘teamwork and communication’ and ‘task management’. The internal consistency for the ratings of elements in categories was acceptable (Cronbach's α of 0.78, 0.77 and 0.69, respectively), with more modest inter‐rater reliability (intraclass correlations for categories 0.54, 0.70, 0.86), test–retest reliability (intraclass correlations 0.68, 0.58, 0.38) and accuracy (weighted kappa 0.39). Most participants considered the system complete (n = 42, 87%), the wording clear (n = 48, 100%) and the system useful for structuring observation (n = 48, 100%).