Premium
Conditional inference for predictive agreement
Author(s) -
Farewell V. T.,
Sprott D. A.
Publication year - 1999
Publication title -
statistics in medicine
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.996
H-Index - 183
eISSN - 1097-0258
pISSN - 0277-6715
DOI - 10.1002/(sici)1097-0258(19990630)18:12<1435::aid-sim150>3.0.co;2-f
Subject(s) - inference , computer science , predictive inference , econometrics , statistics , artificial intelligence , bayesian inference , frequentist inference , mathematics , bayesian probability
We introduce the concept, and a measure of predictive agreement, τ , for two raters classifying items into q categories. The measure is based on the linear combination of log odds ratios from 2×2 subtables of a q × q cross‐classification table. We show that analysis procedures for this measure, and transforms of it, can be based on conditional likelihood procedures. These procedures are exact, which is particularly helpful because of the small tabular cell frequencies which can typically arise with agreement data. To illustrate the advantages of the methodology, examples of typical agreement data arising from medical studies are considered. We demonstrate that the conditional likelihood function portrays the available sample information about τ , often more appropriately than the maximum likelihood estimate and an associated standard error. We highlight the value of combining information via likelihoods in an example involving 24 2×2 tables. An example involving three categories is used to illustrate that the methodology for the overall agreement measure can be adapted to examine relative agreement between pairs of categories. Copyright © 1999 John Wiley & Sons, Ltd.