Premium
Poisson models for assessing rater agreement in discrete response studies
Author(s) -
Feldstein Michael L.,
Davis Henry T.
Publication year - 1984
Publication title -
british journal of mathematical and statistical psychology
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 3.157
H-Index - 51
eISSN - 2044-8317
pISSN - 0007-1102
DOI - 10.1111/j.2044-8317.1984.tb00788.x
Subject(s) - poisson distribution , statistics , kappa , event (particle physics) , mathematics , econometrics , class (philosophy) , inter rater reliability , poisson regression , computer science , artificial intelligence , medicine , rating scale , physics , geometry , quantum mechanics , population , environmental health
In this paper we discuss a method for assessing agreement among raters who are scoring the number of times, a specified event occurs. In such cases, it seems reasonable to define agreement in terms of raters' behaviours in correctly identifying responses which have in fact occurred, and in their falsely counting responses which have not. We exploit the discrete nature of the response variable, and examine a class of models for mean response assuming an underlying Poisson distribution. Test statistics are given for deciding on the applicability of the models, and whether there is agreement with respect to correctly detecting responses, as well as with falsely scoring responses.