Using the Delphi Technique and Focus-Group Interviews to Determine Item Bias on the Mathematics Section of the Level Determination Exam for 2012
Using the Delphi Technique and Focus-Group Interviews to Determine Item Bias on the Mathematics Section of the Level Determination Exam for 2012
复制标题
使用德尔菲法和焦点小组访谈确定 2012 年水平确定考试数学部分的项目偏差
DOI:
10.12738/estp.2018.2.0317
复制
发表时间:
2018
期刊:
影响因子:
--
通讯作者:
S. Buyukozturk
中科院分区:
文献类型:
--
作者:
Halime Yildirim;S. Buyukozturk
Citation: Yıldırım, H., & Büyüköztürk, Ş. (2018). Using the Delphi technique and focus-group interviews to determine item bias on the mathematics section of the level determination exam for 2012. Educational Sciences: Theory & Practice, 18, 447–470. http://dx.doi.org/10.12738/estp.2018.2.0317 * This study is a summary of the graduate thesis titled “ An Investigation of Item Bias of the Mathematics Subtest in 2012 year Level Determination Exam” prepared at Gazi University Educational Measurement and Evaluation Department. 1 Correspondence to: Halime Yıldırım, Educational Sciences, Educational Measurement and Evaluation Department, Faculty of Education, Istanbul Medeniyet University, Istanbul Turkey. Email: halime.yldrm@gmail.com 2 Educational Sciences Department, Faculty of Education, Hasan Kalyoncu University, Gaziantep Turkey. Email: senerbuyukozturk@gmail.com Abstract The aim of this study is to determine whether items from the mathematics section of the 2012 Level Determination Exam indicate item bias according to gender and school type. In particular, the process of item bias has been determined using the Delphi technique and focus group interviews. A two-stage mixed method research has been used for the study. While the first stage consists of identifying items that display differential item functioning (DIF) according to gender and school type, the second stage consists of determining the sources of DIF using the Delphi technique and examining through a focus-group interview which DIF sources lead to item bias. Mantel-Haenszel and logistic regression methods have been used for DIF analysis. While two items with significant DIF were detected according to gender, five items in favor of private schools were detected according to school type. In the process of item bias, the reasons why items display DIF have been determined using the Delphi technique, and 22 DIF sources were agreed upon. Finally, an expert panel was made to examine whether the DIF sources are grounds for item bias or not. According to the panel of experts, one item according to gender and two items according to the school type have been determined to show bias.