Premium
Variations in methods of calculating reliability of duration data
Author(s) -
Wyatt W. Joseph,
Callahan Edward J.,
Michael Joel
Publication year - 1985
Publication title -
psychology in the schools
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.738
H-Index - 75
eISSN - 1520-6807
pISSN - 0033-3085
DOI - 10.1002/1520-6807(198510)22:4<473::aid-pits2310220419>3.0.co;2-n
Subject(s) - stopwatch , reliability (semiconductor) , psychology , duration (music) , event (particle physics) , inter rater reliability , statistics , developmental psychology , mathematics , rating scale , art , power (physics) , physics , literature , quantum mechanics
The traditional percentage and correlational methods of estimating reliability of duration recording were compared to the reliability obtained with an event‐by‐event examination of observers' records in which the actual percentage of time that the observers were in agreement was calculated. While observing standardized videotapes, eight volunteer undergraduate students recorded “studying” using a specific definition and “not eating” using a nonspecific definition. The order of persentation and level of definition specificity were reversed for eight additional volunteer observers. Recordings were done on an event recorder. It was found that the traditional percentage reliability scores were significantly higher than actual (event‐by‐event) observer agreement for both behaviors, at both levels of definition specificity. Correlational reliability coefficients were significantly greater than event‐by‐event scores for specific definitions only. Implications of the findings include the possibility that duration recording, which does not involve a permanent product (e.g., when using a stopwatch), may be periodically checked for reliability with an event recorder, or that interval recording may be used.