Premium
Interrater agreement of nasal endoscopy in patients with a prior history of endoscopic sinus surgery
Author(s) -
McCoul Edward D.,
Smith Timothy L.,
Mace Jess C.,
Anand Vijay K.,
Senior Brent A.,
Hwang Peter H.,
Stankiewicz James A.,
Tabaee Abtin
Publication year - 2012
Publication title -
international forum of allergy and rhinology
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.503
H-Index - 46
eISSN - 2042-6984
pISSN - 2042-6976
DOI - 10.1002/alr.21058
Subject(s) - medicine , cohen's kappa , inter rater reliability , rhinology , chronic rhinosinusitis , kappa , meatus , nasal polyps , endoscopy , functional endoscopic sinus surgery , ethmoid sinus , otorhinolaryngology , concordance , sinusitis , nuclear medicine , surgery , radiology , psychology , developmental psychology , linguistics , rating scale , philosophy , machine learning , computer science
Abstract Background: Nasal endoscopy is an important part of the clinical evaluation of patients with chronic rhinosinusitis. However, the objectivity and interrater agreement of the procedure related findings have not been well studied, especially in patients who have previously had sinus surgery. Methods: Patients with a history of endoscopic sinus surgery for chronic rhinosinusitis were prospectively enrolled from a tertiary rhinology practice. Fourteen endoscopic nasal examinations were recorded using digital video capture software. Each patient also underwent computed tomography (CT) and completed the Sinonasal Outcome Test (SNOT‐22). Blinded review of inflammatory and anatomic findings for each video was independently performed by 5 academic rhinologists at separate institutions. Comparisons were performed using the unweighted Fleiss' kappa statistic (K f ) and the prevalence‐ and bias‐adjusted kappa (PABAK). Results: There were no significant correlations between age, Lund‐Mackay score, or SNOT‐22 score. Interrater agreement was variable across the characteristics studied. Mean PABAK was excellent for the assessment of polyps (K f = 0.886); moderate for the assessments of middle turbinate (MT) integrity (K f = 0.543), MT position (K f = 0.443), maxillary sinus patency (K f = 0.593), and ethmoid sinus patency (K f = 0.429); fair for discharge (K f = 0.314), synechiae (K f = 0.257), and middle meatus patency (K f = 0.229); and poor for MT mucosal changes (K f = 0.148) and uncinate process (K f = 0.126). Conclusion: This study was notable for variability in the interrater agreement among the inflammatory and anatomic attributes that were examined. Further standardization of nasal endoscopy with regard to interpretation may improve the reliability of this procedure in clinical practice. ©2012 ARSAAOA, LLC.