Premium
A new method of assessment of clinical teaching: ROC analysis
Author(s) -
Brickley M R,
Prytherch I M,
Kay E J,
Shepherd J P
Publication year - 1995
Publication title -
medical education
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.776
H-Index - 138
eISSN - 1365-2923
pISSN - 0308-0110
DOI - 10.1111/j.1365-2923.1995.tb02819.x
Subject(s) - molar , rating scale , dentistry , medicine , scale (ratio) , receiver operating characteristic , orthodontics , psychology , medical education , physical therapy , developmental psychology , physics , quantum mechanics
SUMMARY Twenty‐five clinical dental students with varying clinical experience were presented with case records consisting of a clinical history and a panoramic radiograph for 25 patients with bilateral lower third molars (‘wisdom teeth’). The students were asked to indicate how certain they were that each lower third molar tooth needed removal using a 6‐point rating scale. Immediately following the task, the students were presented with information on the indications for removal of lower third molars in the form of a lecture by a senior academic clinical teacher. One week later the students were asked to repeat the rating study, under the same conditions as before, using a further 25 clinical cases. Receiver operating characteristics (ROC) analysis, which provides a graphical and quantitative assessment of a group of observers’ ability to detect need for treatment, was utilized to examine differences between junior and senior students and between the matched pre‐training and post‐training experiments. The ability of junior students to assign lower third molars for surgery was statistically no better than random selection of cases. Formal clinical teaching significantly improved this group's performance, but had no effect on the performance of senior students. Senior students were significantly better able correctly to assign lower third molars for surgical intervention than junior students. Therefore this study shows that clinical experience has a significantly greater influence on treatment‐planning ability than formal teaching. ROC analysis is a useful tool for assessing the effectiveness of methods of undergraduate training.