Application of the bi-factor multidimensional item response theory model to testlet-based tests
Application of the bi-factor multidimensional item response theory model to testlet-based tests
复制标题
DOI：
10.1111/j.1745-3984.2006.00010.x
复制
发表时间：
2006-06-01
影响因子：
1.3
通讯作者：
DeMars, Christine E.
中科院分区：
文献类型：
--
作者：
DeMars, Christine E.
使用测试数据对四个项目反应理论 (IRT) 模型进行了比较，其中多个项目被分组为专注于共同刺激的测试集。在双因素模型中，每个项目都被视为主要特征加上测试组造成的讨厌特征的函数；在 testlet 效应模型中，每个 testlet 内 testlet 性状方向的斜率被限制为与主要性状方向的斜率成比例；在多分模型中，项目分数被汇总为每个 testlet 的单个分数；在独立项目模型中，测试结构被忽略。使用模拟数据，当测试集中的项目不独立时，独立项目模型在某种程度上高估了可靠性。在这些非独立条件下，独立项目模型还产生了更大的项目难度均方根误差 (RMSE)，并低估了项目斜率。当测试集中的项目被生成为独立时，双因素模型在难度和斜率上产生稍高的 RMSE。模型之间的类似差异用实际数据来说明。
Four item response theory (IRT) models were compared using data from tests where multiple items were grouped into testlets focused on a common stimulus. In the bi-factor model each item was treated as a function of a primary trait plus a nuisance trait due to the testlet; in the testlet-effects model the slopes in the direction of the testlet traits were constrained within each testlet to be proportional to the slope in the direction of the primary trait; in the polytomous model the item scores were summed into a single score for each testlet; and in the independent-items model the testlet structure was ignored. Using the simulated data, reliability was overestimated somewhat by the independent-items model when the items were not independent within testlets. Under these nonindependent conditions, the independent-items model also yielded greater root mean square error (RMSE) for item difficulty and underestimated the item slopes. When the items within testlets were instead generated to be independent, the bi-factor model yielded somewhat higher RMSE in difficulty and slope. Similar differences between the models were illustrated with real data.