Flip it: An exploratory (versus explanatory) sequential mixed methods design using Delphi and differential item functioning to evaluate item bias

Flip it: An exploratory (versus explanatory) sequential mixed methods design using Delphi and differential item functioning to evaluate item bias
复制标题

翻转它:使用 Delphi 和微分项目功能来评估项目偏差的探索性(相对于解释性)顺序混合方法设计

DOI:
10.1016/j.metip.2023.100117
复制
发表时间:
2023
影响因子:
--
通讯作者:
Bostic, Jonathan D.
Bostic, Jonathan D.
中科院分区:
--
文献类型:
--
作者:
Koskey, Kristin L.K.;May, Toni A.;Fan, Yiyun “Kate”;Bright, Dara;Stone, Gregory;Matney, Gabriel;Bostic, Jonathan D.

文献摘要

参考文献

相似文献

德尔菲法已被改编为教育和心理评估发展的项目细化。使用德尔菲的解释性序贯混合方法设计是一种常见的方法,可以让专家深入了解为什么项目可能在一个亚组中表现出差异项目功能(DIF),表明潜在的项目偏倚。文献中缺乏使用Delphibeforquantitative现场测试来筛选导致项目偏倚的潜在来源。探索性序贯设计作为一种额外的方法,在I期使用德尔菲技术,在II期使用Rasch DIF分析。我们引入了2 × 2一致性整合类型学,作为一种系统的方法,使用一致性联合显示表来检查定性和定量结果的一致性和不一致性。一个工作的例子,从发展的问题解决措施等级6-8计算机自适应测试支持使用探索性序贯设计,以告知项目细化。2 × 2一致性整合类型学(a)明确了可能需要额外改进的情况,(B)提供了对整个项目集的偏倚分布进行评价。推进数据集成技术和使用混合方法,以提高仪器的开发的影响进行了讨论。
The Delphi method has been adapted to inform item refinements in educational and psychological assessment development. An explanatory sequential mixed methods design using Delphi is a common approach to gain experts' insight into why items might have exhibited differential item functioning (DIF) for a sub-group, indicatingpotentialitem bias. Use of Delphibeforequantitative field testing to screen for potential sources leading to item bias is lacking in the literature. An exploratory sequential design is illustrated as an additional approach using a Delphi technique in Phase I and Rasch DIF analyses in Phase II. We introduce the 2 × 2 Concordance Integration Typology as a systematic way to examine agreement and disagreement across the qualitative and quantitative findings using a concordance joint display table. A worked example from the development of the Problem-Solving Measures Grades 6–8 Computer Adaptive Tests supported using an exploratory sequential design to inform item refinement. The 2 × 2 Concordance Integration Typology (a) crystallized instances where additional refinements were potentially needed and (b) provided for evaluating the distribution of bias across the set of items as a whole. Implications are discussed for advancing data integration techniques and using mixed methods to improve instrument development.
DOI: 10.1177/104973239800800307
发表时间: 1998-05-01
影响因子: 3.2
作者:
Morgan, DL
通讯作者: Morgan, DL
使用德尔菲法和焦点小组访谈确定 2012 年水平确定考试数学部分的项目偏差
DOI: 10.12738/estp.2018.2.0317
发表时间: 2018
期刊: Kuram Ve Uygulamada Egitim Bilimleri
影响因子: --
作者:
Halime Yildirim;S. Buyukozturk
通讯作者: S. Buyukozturk
DOI: 10.1007/s10803-019-03887-4
发表时间: 2019
影响因子: 3.9
作者:
A. Dutt;Marilyn Tan;S. Alagumalai;R. Nair
通讯作者: R. Nair
DOI: 10.7334/psicothema2017.183
发表时间: 2018-02-01
期刊: PSICOTHEMA
影响因子: 3.6
作者:
Gomez-Benito, Juana;Sireci, Stephen;Benitez, Isabel
通讯作者: Benitez, Isabel
DOI: 10.1177/1558689817712119
发表时间: 2019-04-01
影响因子: 3.9
作者:
Bustamante, Carolina
通讯作者: Bustamante, Carolina