Premium
Effects of Scale Transformation and Test‐Termination Rule on the Precision of Ability Estimation in Computerized Adaptive Testing
Author(s) -
Yi Qing,
Wang Tianyou,
Ban JaeChun
Publication year - 2001
Publication title -
journal of educational measurement
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.917
H-Index - 47
eISSN - 1745-3984
pISSN - 0022-0655
DOI - 10.1111/j.1745-3984.2001.tb01127.x
Subject(s) - statistics , computerized adaptive testing , standard error , estimation , scale (ratio) , mean squared error , mathematics , test (biology) , transformation (genetics) , observational error , psychometrics , paleontology , biochemistry , quantum mechanics , gene , economics , biology , physics , chemistry , management
Error indices (bias, standard error of estimation, and root mean squared error) obtained on different measurement scales under different test‐termination rules in computerized adaptive testing (CAT) were examined. Four ability estimation methods (maximum likelihood estimation, weighted likelihood estimation, expected a posterior, and maximum a posterior), three measurement scales (θ, number‐correct score, and ACT score), and three test‐termination rules (fixed length, fixed standard error, and target information) were studied for a real and a generated item pool. The findings indicated that the amount and direction of bias, standard error of estimation, and root mean squared error obtained under different ability estimation methods were influenced both by scale transformations and by test‐termination rules in a CAT environment. The implications of these effects for testing programs are discussed.