Open AccessSTATISTICAL PROCEDURES TO EVALUATE QUALITY OF SCALE ANCHORING
Author(s) -
Haberman Shelby J.,
Sinharay Sandip,
Lee YiHsuan
Publication year - 2011
Publication title -
ets research report series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.235
H-Index - 5
ISSN - 2330-8516
DOI - 10.1002/j.2333-8504.2011.tb02238.x
Subject(s) - anchoring , test (biology) , scale (ratio) , psychology , quality (philosophy) , test score , statistical hypothesis testing , computer science , statistics , social psychology , mathematics education , standardized test , mathematics , paleontology , philosophy , physics , epistemology , quantum mechanics , biology
Providing information to test takers and test score users about the abilities of test takers at different score levels has been a persistent problem in educational and psychological measurement (Carroll, 1993). Scale anchoring (Beaton & Allen, 1992), a technique that describes what students at different points on a score scale know and can do, is a tool to provide such information. Scale anchoring for a test involves substantial amount of work, both by the statistical analysts and test developers involved with the test. In addition, scale anchoring involves considerable use of subjective judgment, so its conclusions may be questionable. This paper describes statistical procedures that can be used to determine if scale anchoring is likely to be successful for a test. If these procedures indicate that scale anchoring is unlikely to be successful, then there is little reason to perform a detailed scale anchoring study. The procedures are applied to several data sets from a teacher licensing test.