Premium
Alignment of Mathematics State‐Level Standards and Assessments: The Role of Reviewer Agreement
Author(s) -
Webb Noreen M.,
Herman Joan L.,
Webb Norman L.
Publication year - 2007
Publication title -
educational measurement: issues and practice
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.158
H-Index - 52
eISSN - 1745-3992
pISSN - 0731-1745
DOI - 10.1111/j.1745-3992.2007.00091.x
Subject(s) - agreement , test (biology) , state (computer science) , psychology , computer science , mathematics , econometrics , statistics , algorithm , linguistics , philosophy , paleontology , biology
This article examines the role of reviewer agreement in judgments about alignment between tests and standards. We used case data from three state alignment studies to explore how different approaches to incorporating reviewer agreement changes alignment conclusions. The three case studies showed varying degrees of reviewer agreement about correspondences between objectives and test items. Moreover, taking into account reviewer agreement in the analyses sometimes had a marked effect on alignment conclusions. We discuss reasons for differences across case studies and alignment approaches, as well as implications for future alignment efforts.