Open AccessDOES LINKING MIXED‐FORMAT TESTS USING A MULTIPLE‐CHOICE ANCHOR PRODUCE COMPARABLE RESULTS FOR MALE AND FEMALE SUBGROUPS?
Author(s) -
Kim Sooyeon,
Walker Michael E.
Publication year - 2011
Publication title -
ets research report series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.235
H-Index - 5
ISSN - 2330-8516
DOI - 10.1002/j.2333-8504.2011.tb02280.x
Subject(s) - licensure , test (biology) , set (abstract data type) , function (biology) , correlation , psychology , statistics , mathematics , social psychology , mathematics education , econometrics , computer science , medicine , medical education , biology , paleontology , geometry , programming language , evolutionary biology
This study examines the use of subpopulation invariance indices to evaluate the appropriateness of using a multiple‐choice (MC) item anchor in mixed‐format tests, which include both MC and constructed‐response (CR) items. Linking functions were derived in the nonequivalent groups with anchor test (NEAT) design using an MC‐only anchor set for 4 mixed‐format licensure tests. For each of those licensure tests, the linking functions were also derived separately for males and females, and those subpopulation functions were compared to the total group function. The mathematics, social studies, and science tests each produced acceptable differences between each of the subpopulation functions and the total group function within the cut‐score region, leading to consistent pass/fail designations for the examinees. The English test, which had a low correlation between MC and CR components (indicative of multidimensionality), produced the largest differences, casting doubt on the effectiveness of the MC‐only anchor.