Detection of Item Preknowledge Using Likelihood Ratio Test and Score Test

Detection of Item Preknowledge Using Likelihood Ratio Test and Score Test
复制标题

使用似然比测试和分数测试检测项目预知识

DOI:
10.3102/1076998616673872
复制
发表时间:
2017
影响因子:
2.4
通讯作者:
S. Sinharay
S. Sinharay
中科院分区:
心理学4区
文献类型:
--
作者:
S. Sinharay

文献摘要

被引文献

相似文献

教育评估制作方越来越关注评估过程中的欺诈行为(van der Linden, 2009)。从项目预知中获益(例如,Eckerly, 2017; McLeod, Lewis, & Thissen, 2003)是一种欺诈行为。本文提出了两种新的测试统计量,用于检测可能受益于项目预知的个体;统计数据可用于非适应性和适应性评估,这些评估可能包括二分法和多二分法项目中的一项或两项。每个新统计量都有一个渐近标准正态n分布。详细的仿真研究表明,在解决相同问题时,新统计量的第一类错误率接近标称水平,新统计量的幂值大于现有统计量的幂值。
An increasing concern of producers of educational assessments is fraudulent behavior during the assessment (van der Linden, 2009). Benefiting from item preknowledge (e.g., Eckerly, 2017; McLeod, Lewis, & Thissen, 2003) is one type of fraudulent behavior. This article suggests two new test statistics for detecting individuals who may have benefited from item preknowledge; the statistics can be used for both nonadaptive and adaptive assessments that may include either or both of dichotomous and polytomous items. Each new statistic has an asymptotic standard normal n distribution. It is demonstrated in detailed simulation studies that the Type I error rates of the new statistics are close to the nominal level and the values of power of the new statistics are larger than those of an existing statistic for addressing the same problem.