z-logo
open-access-imgOpen Access
The Agreement Measure γcat a Complement to γ Focused on Categorization of a Continuum
Author(s) -
Yann Mathet
Publication year - 2017
Publication title -
computational linguistics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.314
H-Index - 98
eISSN - 1530-9312
pISSN - 0891-2017
DOI - 10.1162/coli_a_00296
Subject(s) - categorization , complement (music) , consistency (knowledge bases) , measure (data warehouse) , confusion , agreement , computer science , variation (astronomy) , mathematics , artificial intelligence , natural language processing , data mining , psychology , physics , linguistics , philosophy , astrophysics , biochemistry , chemistry , complementation , psychoanalysis , gene , phenotype
Agreement on unitizing, where several annotators freely put units of various sizes and categories on a continuum, is difficult to assess because of the simultaneaous discrepancies in positioning and categorizing. The recent agreement measure γ offers an overall solution that simultaneously takes into account positions and categories. In this article, I propose the additional coefficient γcat, which complements γ by assessing the agreement on categorization of a continuum, putting aside positional discrepancies. When applied to pure categorization (with predefined units), γcat behaves the same way as the famous dedicated Krippendorff's α, even with missing values, which proves its consistency. A variation of γcat is also proposed that provides an in-depth assessment of categorizing for each individual category. The entire family of γ coefficients is implemented in free software.

The content you want is available to Zendy users.

Already have an account? Click here to sign in.
Having issues? You can contact us here
Accelerating Research

Address

John Eccles House
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom