Item Selection Methods in Multidimensional Computerized Adaptive Testing with Polytomously-scored Items
Item Selection Methods in Multidimensional Computerized Adaptive Testing with Polytomously-scored Items
复制标题
多维计算机自适应测试中多分评分项目的项目选择方法
DOI：
10.1177/0146621618762748
复制
发表时间：
2018
影响因子：
1.2
通讯作者：
Cai Y.
中科院分区：
文献类型：
--
作者：
Tu D. B.;Hang Y. T.;Cai Y.
多维计算机自适应测验（MCAT）是近几十年来发展起来的一种测验，但大多数都只能处理二分题。而多项评分题因其信息量大、测试能力复杂等优点，在各种测试中得到了广泛的应用。本研究的目的是探讨多分类评分项目的MCAT（PMCAT）中的项目选择算法。将MCAT中的几种有前途的项目选择算法推广到PMCAT中，并提出了两种新的项目选择方法来改进现有的选择策略。两个仿真研究进行了证明的扩展和建议的方法的可行性。仿真结果表明，大多数扩展的PMCAT项目选择方法是可行的，新提出的项目选择方法的性能良好。结合池的安全性，当考虑两个维度时（研究1），所提出的改进的连续熵方法（MCEM）是所有方法中的理想方法，因为它获得了最低的项目暴露率，并具有相对较高的准确性。对于高维度（研究2），结果表明，互信息（MUI）和MCEM保持相对较高的估计精度，项目暴露率随着相关性的增加而降低。
Multidimensional computerized adaptive testing (MCAT) has been developed over the past decades, and most of them can only deal with dichotomously scored items. However, polytomously scored items have been broadly used in a variety of tests for their advantages of providing more information and testing complicated abilities and skills. The purpose of this study is to discuss the item selection algorithms used in MCAT with polytomously scored items (PMCAT). Several promising item selection algorithms used in MCAT are extended to PMCAT, and two new item selection methods are proposed to improve the existing selection strategies. Two simulation studies are conducted to demonstrate the feasibility of the extended and proposed methods. The simulation results show that most of the extended item selection methods for PMCAT are feasible and the new proposed item selection methods perform well. Combined with the security of the pool, when two dimensions are considered (Study 1), the proposed modified continuous entropy method (MCEM) is the ideal of all in that it gains the lowest item exposure rate and has a relatively high accuracy. As for high dimensions (Study 2), results show that mutual information (MUI) and MCEM keep relatively high estimation accuracy, and the item exposure rates decrease as the correlation increases.