Open AccessTHE EFFECTIVENESS OF ENHANCING TEST SECURITY BY USING MULTIPLE ITEM POOLS
Author(s) -
Zhang Jinming,
Chang HuaHua
Publication year - 2005
Publication title -
ets research report series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.235
H-Index - 5
ISSN - 2330-8516
DOI - 10.1002/j.2333-8504.2005.tb01996.x
Subject(s) - test (biology) , computer science , selection (genetic algorithm) , reuse , item bank , scale (ratio) , item response theory , statistics , data mining , machine learning , mathematics , psychometrics , engineering , waste management , paleontology , physics , quantum mechanics , biology
This paper compares the use of multiple pools versus a single pool with respect to test security against large‐scale item sharing among some examinees in a computer‐based test, under the assumption that a randomized item selection method is used. It characterizes the conditions under which employing multiple pools is better than using a single whole pool in terms of minimizing the expected number of compromised items encountered by an examinee. The results obtained in this paper provide guidelines for constructing multiple pools optimally and evaluating the risks associated with some test designs that employ item reuse schemes. Finally, an adjusted‐pool approach is proposed to achieve better test security than either the single‐pool approach or the multiple‐pool approach.