Premium
Observer agreement in the grading of oral epithelial dysplasia
Author(s) -
D. J Brothwell,
D. W Lewis,
G Bradley,
I Leong,
R. C. K Jordan,
D Mock,
J. L Leake
Publication year - 2003
Publication title -
community dentistry and oral epidemiology
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.061
H-Index - 101
eISSN - 1600-0528
pISSN - 0301-5661
DOI - 10.1034/j.1600-0528.2003.00013.x
Subject(s) - medicine , kappa , grading (engineering) , nuclear medicine , gold standard (test) , cohen's kappa , concordance , orthodontics , dentistry , statistics , radiology , mathematics , civil engineering , geometry , engineering
Objectives: To determine the extent of observer agreement in diagnosis of oral epithelial dysplasia (OED). Published studies of OED examiner agreement report relatively low agreement levels; however, these studies were limited by the methodologies employed. Methods: For this study, 64 slides were each independently examined twice by three oral pathologists. Consistency was assessed by determining intra‐ and interexaminer agreement. Conformity was assessed by using the modal diagnosis as a gold standard. Results: The group showed moderate interobserver agreement when grading the presence or absence of OED with a group‐simple kappa ( K s) of 0.51 (95% CI = 0.42–0.61), and substantial agreement when using a 5‐point ordinal scale with a group‐weighted kappa ( K w) of 0.74 (95% CI = 0.64–0.85). The group showed fair to substantial intraexaminer agreement when assessing the presence or absence of OED, with K s ranging from 0.22 to 0.78, and showing almost a perfect agreement using a 5‐point ordinal scale, with K w ranging from 0.82–0.96. Conformity with the comparison standard modal diagnosis was almost perfect, with pairwise K w ranging from 0.81 to 0.92. Conclusion: Overall, there was substantial intra‐ and interobserver consistency and almost perfect conformity in the grading of OED. Appropriate statistical methods are necessary to determine the degree of observer agreement.