Premium
EMPIRICAL SYNTHESIS OF THE EFFECT OF STANDARD ERROR OF MEASUREMENT ON DECISIONS MADE WITHIN BRIEF EXPERIMENTAL ANALYSES OF READING FLUENCY
Author(s) -
Burns Matthew K.,
Taylor Crystal N.,
WarmboldBrann Kristy L.,
Preast June L.,
Hosp John L.,
Ford Jeremy W.
Publication year - 2017
Publication title -
psychology in the schools
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.738
H-Index - 75
eISSN - 1520-6807
pISSN - 0033-3085
DOI - 10.1002/pits.22022
Subject(s) - fluency , curriculum based measurement , psychology , baseline (sea) , psychological intervention , reading (process) , intervention (counseling) , standard error , statistics , confidence interval , level of measurement , curriculum , mathematics education , mathematics , pedagogy , curriculum development , oceanography , curriculum mapping , psychiatry , geology , political science , law
Intervention researchers often use curriculum‐based measurement of reading fluency (CBM‐R) with a brief experimental analysis (BEA) to identify an effective intervention for individual students. The current study synthesized data from 22 studies that used CBM‐R data within a BEA by computing the standard error of measure (SEM) for the median data point from the baseline and intervention data. The median CBM‐R score from the intervention that the authors of each study identified as most effective fell within the SEM (68% confidence interval) of the baseline data approximately 30% of the time, but the ranges for the two author‐identified most effective interventions overlapped over 75% of the time. Extended analyses were consistent with the BEA results for approximately three‐fourths of the instances after considering the SEM of the baseline and intervention phases. Using matched passages did not improve the overlap of the ranges, but there was less overlap when the study used three data points per condition. Results emphasize the importance of considering SEM of CBM‐R data when comparing interventions within a BEA. Further implications for practice and future research are included.