Premium
Instructional Topics in Educational Measurement (ITEMS) Module: Using Automated Processes to Generate Test Items
Author(s) -
Gierl Mark J.,
Lai Hollis
Publication year - 2013
Publication title -
educational measurement: issues and practice
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.158
H-Index - 52
eISSN - 1745-3992
pISSN - 0731-1745
DOI - 10.1111/emip.12018
Subject(s) - computer science , rendering (computer graphics) , test (biology) , item bank , process (computing) , item response theory , task (project management) , item analysis , artificial intelligence , machine learning , information retrieval , psychometrics , programming language , psychology , engineering , paleontology , clinical psychology , biology , systems engineering
Changes to the design and development of our educational assessments are resulting in the unprecedented demand for a large and continuous supply of content‐specific test items. One way to address this growing demand is with automatic item generation (AIG). AIG is the process of using item models to generate test items with the aid of computer technology. The purpose of this module is to describe and illustrate a template‐based method for generating test items. We outline a three‐step approach where test development specialists first create an item model. An item model is like a mould or rendering that highlights the features in an assessment task that must be manipulated to produce new items. Next, the content used for item generation is identified and structured. Finally, features in the item model are systematically manipulated with computer‐based algorithms to generate new items. Using this template‐based approach, hundreds or even thousands of new items can be generated with a single item model.