Judge Consistency and Severity Across Grading Periods
Judge Consistency and Severity Across Grading Periods
复制标题
评判各个评分期间的一致性和严重性
DOI：
--
复制
发表时间：
1990
期刊：
影响因子：
--
通讯作者：
J. Stahl
中科院分区：
文献类型：
--
作者：
M. Lunz;J. Stahl
本研究项目的目的是证实，无论评估的性质或使用的考试材料如何，法官的严厉程度和评分期的严格程度都会存在差异。三个相当不同的考试，需要法官进行了分析，使用扩展的Rasch模型，以确定是否在法官的严重程度和分级期间的严格性的差异是观察到的所有三个考试。法官的严重程度和一些变化，发现在所有三个考试分级期间的显着变化。这意味着，无论检查、项目或法官的性质如何，除非系统地对严重程度进行纠正，否则不能将被检查者/措施视为独立于所涉及的特定法官。当通过/失败的决定是为了推广到能力，如在认证考试，会计法官的严重性和gradinig-period严格性是极其重要的。
The purpose of this research project was to confirm that differences in the severity of judges and the stringency of grading periods occur, regardless of the nature of the assessment or the examination materials used. Three rather different examinations that require judges were analyzed, using an extended Rasch model to determine whether differences in judge severity and grading-period stringency were observable for all three examinations. Significant variation in judge severity and some variation across grading periods were found on all three examinations. This implies that regardless of the nature of the examination, items, or judges, examinee/measures cannot be considered independent of the particular judges involved unless correction for severity is made systematically. Accounting for judge severity and gradinig-period stringency is extremely important when pass/fail decisions that are meant to generalize to competence are made, as in certification examinations.