Premium
Analysis of disagreement in the evaluation of clinical products
Author(s) -
Mackenzie RS,
Antonson DE,
Weldy PL,
Welsch BB,
Simpson WJ
Publication year - 1982
Publication title -
journal of dental education
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.53
H-Index - 68
eISSN - 1930-7837
pISSN - 0022-0337
DOI - 10.1002/j.0022-0337.1982.46.5.tb01556.x
Subject(s) - task (project management) , observational study , psychology , applied psychology , process (computing) , medical education , clinical psychology , cognitive psychology , computer science , medicine , pathology , engineering , systems engineering , operating system
This paper reports an analysis of factors that reduce agreement in clinical evaluation. Four instructors representing different restorative departments met regularly over a four‐month period to study the evaluation process. Each participant selected a task from his discipline, identified critical errors made in performing the task, produced these errors in models and extracted teeth, and developed criteria and checklists to aid in categorizing and counting the errors. In weekly sessions the models were evaluated, and judgments were compared. Factors that reduced agreement were identified, discussed, and listed. In some sessions ongoing evaluation was reported orally, tape‐recorded, and analyzed to elucidate the underlying mental processes. Analysis indicated that agreement was reduced by 16 factors, including unclear rules, the faculty member's memory, unstandardized aids to judgment, inconsistent observational methods, differences in ability, and differing tendencies to leniency.