Open AccessA SIMULATION STUDY TO EXPLORE CONFIGURING THE NEW SAT® CRITICAL READING SECTION WITHOUT ANALOGY ITEMS
Author(s) -
Liu Jinghua,
Feigenbaum Miriam,
Cook Linda
Publication year - 2004
Publication title -
ets research report series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.235
H-Index - 5
ISSN - 2330-8516
DOI - 10.1002/j.2333-8504.2004.tb01928.x
Subject(s) - analogy , statistics , section (typography) , reading (process) , reliability (semiconductor) , item response theory , standard error , test (biology) , computer science , mathematics , psychology , psychometrics , linguistics , power (physics) , paleontology , physics , quantum mechanics , biology , operating system , philosophy
This study explored possible configurations of the new SAT® critical reading section without analogy items. The item pool contained items from SAT verbal (SAT–V) sections of 14 previously administered SAT tests, calibrated using the three‐parameter logistic IRT model. Multiple versions of several prototypes that do not contain analogy items were assembled. Item statistics and test statistics for the simulated forms were compared to the average of 13 forms of the SAT–V. These statistics included: IRT scaled score reliability, scaled score standard error of measurement, conditional scaled score standard error of measurement, r ‐biserial, and equated deltas. The results indicated that it is possible to maintain measurement precision for the new SAT critical reading section without analogy items, but it may be necessary to modify the distribution of item difficulty in order to obtain adequate precision at the ends of the score scale.