Premium
Measurement Efficiency of Innovative Item Formats in Computer‐Based Testing
Author(s) -
Jodoin Michael G.
Publication year - 2003
Publication title -
journal of educational measurement
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.917
H-Index - 47
eISSN - 1745-3984
pISSN - 0022-0655
DOI - 10.1111/j.1745-3984.2003.tb01093.x
Subject(s) - item response theory , multiple choice , item bank , computer science , psychometrics , test (biology) , item analysis , applied psychology , psychology , information retrieval , statistics , mathematics , clinical psychology , significant difference , paleontology , biology
The psychometric literature provides little empirical evaluation of examinee test data to assess essential psychometric properties of innovative items. In this study, examinee responses to conventional (e.g., multiple choice) and innovative item formats in a computer‐based testing program were analyzed for IRT information with the three‐parameter and graded response models. The innovative item types considered in this study provided more information across all levels of ability than multiple‐choice items. In addition, accurate timing data captured via computer administration were analyzed to consider the relative efficiency of the multiple choice and innovative item types. As with previous research, multiple‐choice items provide more information per unit time. Implications for balancing policy, psychometric, and pragmatic factors in selecting item formats are also discussed.