Premium
Observer agreement calculations: The role of primary data in reducing obfuscation
Author(s) -
Harrop Alex,
Foulkes Christine,
Daniels Michael
Publication year - 1989
Publication title -
british journal of psychology
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.536
H-Index - 92
eISSN - 2044-8295
pISSN - 0007-1269
DOI - 10.1111/j.2044-8295.1989.tb02312.x
Subject(s) - contingency table , observer (physics) , psychology , agreement , contingency , statistics , contrast (vision) , econometrics , artificial intelligence , mathematics , computer science , physics , linguistics , philosophy , quantum mechanics
By the use of momentary time‐sampling data obtained from a pair of observers, various indices of observer agreement were computed. An analysis of the results showed that conflicting claims could be made for the adequacy of the observers’ agreement levels depending upon which indices were used. By contrast, visual inspection of the primary data in contingency tables was seen to reveal full information without introducing any in‐built assumptions. As a consequence, it is suggested that reports which include observer agreement in their results should include contingency tables which show numbers of agreements and disagreements on occurrences and non‐occurrences of behaviour.