Premium
Developing local oral reading fluency cut scores for predicting high‐stakes test performance
Author(s) -
Grapin Sally L.,
Kranzler John H.,
Waldron Nancy,
JoyceBeaulieu Diana,
Algina James
Publication year - 2017
Publication title -
psychology in the schools
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.738
H-Index - 75
eISSN - 1520-6807
pISSN - 0033-3085
DOI - 10.1002/pits.22035
Subject(s) - fluency , receiver operating characteristic , psychology , logistic regression , curriculum based measurement , linear discriminant analysis , statistics , calibration , test (biology) , reading (process) , audiology , curriculum , mathematics , mathematics education , medicine , pedagogy , paleontology , curriculum mapping , curriculum development , political science , law , biology
This study evaluated the classification accuracy of a second grade oral reading fluency curriculum‐based measure (R‐CBM) in predicting third grade state test performance. It also compared the long‐term classification accuracy of local and publisher‐recommended R‐CBM cut scores. Participants were 266 students who were divided into a calibration sample ( n = 170) and two cross‐validation samples ( n = 46; n = 50), respectively. Using calibration sample data, local fall, winter, and spring R‐CBM cut scores for predicting students’ state test performance were developed using three methods: discriminant analysis (DA), logistic regression (LR), and receiver operating characteristic curve analysis (ROC). The classification accuracy of local and publisher‐recommended cut scores was evaluated across subsamples. Only DA and ROC produced cut scores that maintained adequate sensitivity (≥.70) across cohorts; however, LR and publisher‐recommended scores had higher levels of specificity and overall correct classification. Implications for developing local cut scores are discussed.