Premium
Hybrid Computerized Adaptive Testing: From Group Sequential Design to Fully Sequential Design
Author(s) -
Wang Shiyu,
Lin Haiyan,
Chang HuaHua,
Douglas Jeff
Publication year - 2016
Publication title -
journal of educational measurement
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.917
H-Index - 47
eISSN - 1745-3984
pISSN - 0022-0655
DOI - 10.1111/jedm.12100
Subject(s) - sequential analysis , robustness (evolution) , estimator , computer science , computerized adaptive testing , adaptive design , implementation , group testing , algorithm , computer engineering , mathematics , statistics , psychometrics , programming language , medicine , biochemistry , chemistry , pathology , clinical trial , gene , combinatorics
Computerized adaptive testing (CAT) and multistage testing (MST) have become two of the most popular modes in large‐scale computer‐based sequential testing. Though most designs of CAT and MST exhibit strength and weakness in recent large‐scale implementations, there is no simple answer to the question of which design is better because different modes may fit different practical situations. This article proposes a hybrid adaptive framework to combine both CAT and MST, inspired by an analysis of the history of CAT and MST. The proposed procedure is a design which transitions from a group sequential design to a fully sequential design. This allows for the robustness of MST in early stages, but also shares the advantages of CAT in later stages with fine tuning of the ability estimator once its neighborhood has been identified. Simulation results showed that hybrid designs following our proposed principles provided comparable or even better estimation accuracy and efficiency than standard CAT and MST designs, especially for examinees at the two ends of the ability range.