Premium
Identifying Cheating on Unproctored Internet Tests: The Z ‐test and the likelihood ratio test
Author(s) -
Guo Jing,
Drasgow Fritz
Publication year - 2010
Publication title -
international journal of selection and assessment
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.812
H-Index - 61
eISSN - 1468-2389
pISSN - 0965-075X
DOI - 10.1111/j.1468-2389.2010.00518.x
Subject(s) - cheating , test (biology) , statistics , psychology , consistency (knowledge bases) , computerized adaptive testing , the internet , type i and type ii errors , applied psychology , computer science , social psychology , mathematics , artificial intelligence , psychometrics , world wide web , paleontology , biology
Unproctored Internet testing (UIT) is becoming more popular in employment settings due to its cost effectiveness and efficiency. However, one of the major concerns with UIT is the possibility of cheating behaviors: a more capable conspirator can sit beside the real applicant and answer test items, or the applicant may use unauthorized materials. The present study examined the effectiveness of using a proctored verification test following the UIT to identify cheating in UIT, where 2 test statistics, a Z ‐test and a likelihood ratio (LR) test, compare the consistency of test performance across the testing conditions. A simulation study was conducted to test the effectiveness of the two test statistics for a computerized adaptive test format. Results indicate that both test statistics have high power to detect dishonest job applicants at low Type I error rates. Compared with the LR test, the Z ‐test was more efficient and effective and is therefore recommended for practical applications. The theoretical and practical implications are discussed.