Identifying Cheating on Unproctored Internet Tests: The Z-test and the likelihood ratio test
Identifying Cheating on Unproctored Internet Tests: The Z-test and the likelihood ratio test
复制标题
DOI：
10.1111/j.1468-2389.2010.00518.x
复制
发表时间：
2010-12-01
影响因子：
2.2
通讯作者：
Drasgow, Fritz
中科院分区：
文献类型：
--
作者：
Guo, Jing;Drasgow, Fritz
无监督互联网测试（UIT）由于其成本效益和效率而在就业环境中越来越受欢迎。但UIT的一个主要担忧是作弊行为的可能性：一个更有能力的同谋者可以坐在真实的申请人旁边回答测试项目，或者申请人可能使用未经授权的材料。本研究探讨了使用监考验证测试后的UIT，以确定作弊UIT，其中2个测试统计，Z-检验和似然比（LR）测试，比较测试条件下的测试性能的一致性的有效性。进行了模拟研究，以测试计算机自适应测试格式的两个测试统计量的有效性。结果表明，这两个测试统计量有很高的权力，以检测不诚实的求职者在低I型错误率。与LR检验相比，Z检验具有更高的效率和更好的效果，值得在实际应用中推广。的理论和实践意义进行了讨论。
Unproctored Internet testing (UIT) is becoming more popular in employment settings due to its cost effectiveness and efficiency. However, one of the major concerns with UIT is the possibility of cheating behaviors: a more capable conspirator can sit beside the real applicant and answer test items, or the applicant may use unauthorized materials. The present study examined the effectiveness of using a proctored verification test following the UIT to identify cheating in UIT, where 2 test statistics, a Z-test and a likelihood ratio (LR) test, compare the consistency of test performance across the testing conditions. A simulation study was conducted to test the effectiveness of the two test statistics for a computerized adaptive test format. Results indicate that both test statistics have high power to detect dishonest job applicants at low Type I error rates. Compared with the LR test, the Z-test was more efficient and effective and is therefore recommended for practical applications. The theoretical and practical implications are discussed.