Premium
Variance estimation for the Kappa statistic in the presence of clustered data and heterogeneous observations
Author(s) -
Ryan Mary M.,
Spotnitz William D.,
Gillen Daniel L.
Publication year - 2020
Publication title -
statistics in medicine
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.996
H-Index - 183
eISSN - 1097-0258
pISSN - 0277-6715
DOI - 10.1002/sim.8522
Subject(s) - cohen's kappa , statistic , estimator , kappa , variance (accounting) , statistics , computer science , reliability (semiconductor) , scale (ratio) , mathematics , power (physics) , physics , geometry , accounting , quantum mechanics , business
We present a methodology motivated by a controlled trial designed to validate SPOT GRADE, a novel surgical bleeding severity scale. Briefly, the study was designed to quantify inter‐ and intra‐surgeon agreement for characterizing the severity of surgical bleeds via a Kappa statistic. Multiple surgeons were presented with a randomized sequence of controlled bleeding videos and asked to apply the rating system to characterize each wound. Each video was shown multiple times to quantify intra‐surgeon reliability, creating clustered data. In addition, videos within the same category may have had different classification probabilities due to changes in blood flow rates and wound sizes. In this work, we propose a new variance estimator for the Kappa statistic, for use in clustered data as well as heterogeneity among items within the same classification category. We then apply this methodology to data from the SPOT GRADE trial.