A Comparison of Item Calibration Procedures in the Presence of Test Speededness.
A Comparison of Item Calibration Procedures in the Presence of Test Speededness.
复制标题
存在测试速度的项目校准程序的比较。
DOI：
10.1111/j.1745-3984.2012.00176.x
复制
发表时间：
2012
影响因子：
1.3
通讯作者：
James A. Wollack
中科院分区：
文献类型：
--
作者：
Youngsuk Suh;Sun;James A. Wollack
在存在测试快速性的情况下，项目反应理论模型的参数估计可能会由于项目之间的条件依赖而估计得很差，特别是对于测试结束项目(即，加速项目)。本文系统地比较了两参数Logistic(2PL)模型、一维混合模型、两步策略(一维混合模型和2PL模型的组合)、二维混合模型和混合模型这五种项目校正方法在快速测试中对项目参数估计的影响。对于非加速项目，所有五个程序在恢复项目参数方面都显示出类似的结果。对于速度项，一维混合模型、两步策略和二维混合模型的结果基本相似，并且在校正坡度参数方面优于2PL模型和混合模型。然而，这三种方法在估计拦截参数方面的表现与混合模型相似。正如预期的那样，2PL模型在恢复项目参数方面似乎不如其他模型准确，特别是在大量考生表现出快速反应和错误得分的高错误率的情况下。实际数据分析进一步描述了五种程序之间的异同。
In the presence of test speededness, the parameter estimates of item response theory models can be poorly estimated due to conditional dependencies among items, particularly for end-of-test items (i.e., speeded items). This article conducted a systematic comparison of five-item calibration procedures—a two-parameter logistic (2PL) model, a one-dimensional mixture model, a two-step strategy (a combination of the one-dimensional mixture and the 2PL), a two-dimensional mixture model, and a hybrid model-–by examining how sample size, percentage of speeded examinees, percentage of missing responses, and way of scoring missing responses (incorrect vs. omitted) affect the item parameter estimation in speeded tests. For nonspeeded items, all five procedures showed similar results in recovering item parameters. For speeded items, the one-dimensional mixture model, the two-step strategy, and the two-dimensional mixture model provided largely similar results and performed better than the 2PL model and the hybrid model in calibrating slope parameters. However, those three procedures performed similarly to the hybrid model in estimating intercept parameters. As expected, the 2PL model did not appear to be as accurate as the other models in recovering item parameters, especially when there were large numbers of examinees showing speededness and a high percentage of missing responses with incorrect scoring. Real data analysis further described the similarities and differences between the five procedures.