Flip it: An exploratory (versus explanatory) sequential mixed methods design using Delphi and differential item functioning to evaluate item bias
Flip it: An exploratory (versus explanatory) sequential mixed methods design using Delphi and differential item functioning to evaluate item bias
复制标题
翻转它:使用 Delphi 和微分项目功能来评估项目偏差的探索性(相对于解释性)顺序混合方法设计
DOI:
10.1016/j.metip.2023.100117
复制
发表时间:
2023
影响因子:
--
通讯作者:
Bostic, Jonathan D.
中科院分区:
文献类型:
--
作者:
Koskey, Kristin L.K.;May, Toni A.;Fan, Yiyun “Kate”;Bright, Dara;Stone, Gregory;Matney, Gabriel;Bostic, Jonathan D.
The Delphi method has been adapted to inform item refinements in educational and psychological assessment development. An explanatory sequential mixed methods design using Delphi is a common approach to gain experts' insight into why items might have exhibited differential item functioning (DIF) for a sub-group, indicatingpotentialitem bias. Use of Delphibeforequantitative field testing to screen for potential sources leading to item bias is lacking in the literature. An exploratory sequential design is illustrated as an additional approach using a Delphi technique in Phase I and Rasch DIF analyses in Phase II. We introduce the 2 × 2 Concordance Integration Typology as a systematic way to examine agreement and disagreement across the qualitative and quantitative findings using a concordance joint display table. A worked example from the development of the Problem-Solving Measures Grades 6–8 Computer Adaptive Tests supported using an exploratory sequential design to inform item refinement. The 2 × 2 Concordance Integration Typology (a) crystallized instances where additional refinements were potentially needed and (b) provided for evaluating the distribution of bias across the set of items as a whole. Implications are discussed for advancing data integration techniques and using mixed methods to improve instrument development.
登录
查看更多内容
影响因子:
3.2
作者:
Morgan, DL
通讯作者:
Morgan, DL
DOI:
10.12738/estp.2018.2.0317
发表时间:
2018
期刊:
Kuram Ve Uygulamada Egitim Bilimleri
影响因子:
--
作者:
Halime Yildirim;S. Buyukozturk
通讯作者:
S. Buyukozturk
影响因子:
3.9
作者:
A. Dutt;Marilyn Tan;S. Alagumalai;R. Nair
通讯作者:
R. Nair
影响因子:
3.6
作者:
Gomez-Benito, Juana;Sireci, Stephen;Benitez, Isabel
通讯作者:
Benitez, Isabel
影响因子:
3.9
作者:
Bustamante, Carolina
通讯作者:
Bustamante, Carolina