Dealing With Omitted and Not-Reached Items in Competence Tests: Evaluating Approaches Accounting for Missing Responses in Item Response Theory Models
Dealing With Omitted and Not-Reached Items in Competence Tests: Evaluating Approaches Accounting for Missing Responses in Item Response Theory Models
复制标题
DOI：
10.1177/0013164413504926
复制
发表时间：
2014-06-01
影响因子：
2.7
通讯作者：
Rose, Norman
中科院分区：
文献类型：
--
作者：
Pohl, Steffi;Graefe, Linda;Rose, Norman
能力测试的数据通常会显示出一些遗漏的测试项目，由于遗漏和未达到的项目。处理缺失答复的办法各不相同，而且没有明确的准则说明应采用哪种办法。虽然经典的方法依赖于一个可验证的缺失数据机制，但最近开发的基于模型的方法解释了不可验证的缺失响应。基于模型的方法包括测量模型中的缺失倾向。虽然这些模型是非常有前途的，在这些模型中所作的假设还没有经过测试的可验证性的经验数据。此外，调查不同方法性能的研究一次只关注一种缺失的响应。在这项研究中，我们研究了经典和基于模型的方法在经验数据中的表现，同时考虑到不同类型的缺失响应。我们证实了存在一个一维的倾向，省略项目。由于遗漏和未达到的项目导致的缺失倾向与能力相关，表明缺失机制的不可解释性。然而，参数估计的结果表明，忽略缺失响应足以解释缺失响应，并且模型中不需要缺失倾向。实证研究的结果在一个完整的案例模拟中得到了证实。
Data from competence tests usually show a number of missing responses on test items due to both omitted and not-reached items. Different approaches for dealing with missing responses exist, and there are no clear guidelines on which of those to use. While classical approaches rely on an ignorable missing data mechanism, the most recently developed model-based approaches account for nonignorable missing responses. Model-based approaches include the missing propensity in the measurement model. Although these models are very promising, the assumptions made in these models have not yet been tested for plausibility in empirical data. Furthermore, studies investigating the performance of different approaches have only focused on one kind of missing response at once. In this study, we investigated the performance of classical and model-based approaches in empirical data, accounting for different kinds of missing responses simultaneously. We confirmed the existence of a unidimensional tendency to omit items. Indicating nonignorability of the missing mechanism, missing tendency due to both omitted and not-reached items correlated with ability. However, results on parameter estimation showed that ignoring missing responses was sufficient to account for missing responses, and that the missing propensity was not needed in the model. The results from the empirical study were corroborated in a complete case simulation.