Premium
Audit and summative assessment: a completed audit cycle
Author(s) -
Lough J. R. M.,
Murray T. S.
Publication year - 2001
Publication title -
medical education
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.776
H-Index - 138
eISSN - 1365-2923
pISSN - 0308-0110
DOI - 10.1046/j.1365-2923.2001.00868.x
Subject(s) - audit , summative assessment , trainer , medicine , medical education , test (biology) , work (physics) , family medicine , psychology , formative assessment , computer science , accounting , engineering , business , pedagogy , paleontology , mechanical engineering , biology , programming language
Objective To develop and test a system for delivering a completed audit cycle for summative assessment of general practitioner registrars in the United Kingdom. Design A trainer‐based questionnaire on criteria for a completed audit cycle, followed by two marking exercises of audit projects submitted by general practice registrars. Setting Training practices in the West of Scotland between 1997 and 1998. Subjects Trainers and registrars in the above practices. Results 116 (89%) agreed that two collections of data were an essential or desirable part of an audit project. All 57 registrars who started in August 1997 successfully completed an audit cycle, seven (12%) after resubmission. Using two rather than three independent assessors to screen the projects, the marking instrument was shown to have a sensitivity of 95% (95% confidence interval (CI) ±3·9%) and a specificity of 77% (95% CI ±7·5%). All assessors found the new system easier to mark and 47 registrars (87%) found completing an audit cycle as or easier than expected. Conclusion Evidence from the pilot project has shown that a general practice registrar’s ability to review and critically analyse a piece of his/her work, with appropriate management of any necessary change, can be tested feasibly by means of a completed audit cycle within the registrar year. The process retains adequate levels of sensitivity and specificity and requires fewer assessors for marking the projects.