Premium
MULTIPLE‐RESPONDENT ANECDOTAL ASSESSMENTS: AN ANALYSIS OF INTERRATER AGREEMENT AND CORRESPONDENCE WITH ANALOGUE ASSESSMENT OUTCOMES
Author(s) -
Smith Carla M.,
Smith Richard G.,
Dracobly Joseph D.,
Pace Amy Peterson
Publication year - 2012
Publication title -
journal of applied behavior analysis
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.1
H-Index - 76
eISSN - 1938-3703
pISSN - 0021-8855
DOI - 10.1901/jaba.2012.45-779
Subject(s) - inter rater reliability , psychology , respondent , clinical psychology , functional analysis , rating scale , developmental psychology , biochemistry , chemistry , political science , law , gene
We evaluated interrater agreement across multiple respondents on anecdotal assessments and compared cases in which agreement was obtained with outcomes of functional analyses. Experiment 1 evaluated agreement among multiple respondents on the function of problem behavior for 27 individuals across 42 target behaviors using the Motivation Assessment Scale (MAS) and the Questions about Behavioral Function (QABF). Results showed that at least 4 of 5 respondents agreed on the primary maintaining consequence for 52% (22 of 42) of target behaviors with the MAS and 57% (24 of 42) with the QABF. Experiment 2 examined correspondence between the anecdotal assessment results and functional analysis results for 7 individuals for whom at least 4 of 5 respondents showed agreement in Experiment 1. Correspondence with functional analysis results was observed in 6 of 7 cases with the QABF and in 4 of 7 cases with the MAS. Implications of these outcomes for the utility of anecdotal assessments are discussed.