Premium
Constructing Rotating Item Pools for Constrained Adaptive Testing
Author(s) -
Ariel Adelaide,
Veldkamp Bernard P.,
Linden Wim J.
Publication year - 2004
Publication title -
journal of educational measurement
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.917
H-Index - 47
eISSN - 1745-3984
pISSN - 0022-0655
DOI - 10.1111/j.1745-3984.2004.tb01170.x
Subject(s) - computerized adaptive testing , computer science , set (abstract data type) , probabilistic logic , item bank , test (biology) , item response theory , artificial intelligence , statistics , mathematics , psychometrics , paleontology , biology , programming language
Preventing items in adaptive testing from being over‐ or underexposed is one of the main problems in computerized adaptive testing. Though the problem of overexposed items can be solved using a probabilistic item‐exposure control method, such methods are unable to deal with the problem of underexposed items. Using a system of rotating item pools, on the other hand, is a method that potentially solves both problems. In this method, a master pool is divided into (possibly overlapping) smaller item pools, which are required to have similar distributions of content and statistical attributes. These pools are rotated among the testing sites to realize desirable exposure rates for the items. A test assembly model, motivated by Gulliksen's matched random subtests method, was explored to help solve the problem of dividing a master pool into a set of smaller pools. Different methods to solve the model are proposed. An item pool from the Law School Admission Test was used to evaluate the performances of computerized adaptive tests from systems of rotating item pools constructed using these methods.