Evaluation of Source Code with Item Response Theory

Evaluation of Source Code with Item Response Theory
复制标题

用项目反应理论评估源代码

DOI:
10.1145/2729094.2742619
复制
发表时间:
2015
期刊:
Proceedings of the 2015 ACM Conference on Innovation and Technology in Computer Science Education
影响因子:
--
通讯作者:
Peter Hubwieser
Peter Hubwieser
中科院分区:
--
文献类型:
--
作者:
Marc Berges;Peter Hubwieser

文献摘要

参考文献

被引文献

相似文献

对新手程序员生成的源代码的分析可以为他们的学习进度提供有趣的见解,特别是在入门编程课程中。然而,由于一个人的编程能力被认为是相当复杂的,因此不太可能直接观察到它的整体。相反,我们把这些能力作为潜在的心理测量结构,并应用项目反应理论(IRT)的方法来评估他们的表现。在准备工作中,我们已经确定了一个代表面向对象编程中心概念的项目列表。在本文中,我们提出了一种方法,允许通过分析这些概念的应用程序的编码能力的评价。我们展示了这种方法,通过举例分析源代码,在编程项目中产生的。结果提供了有趣的信息的概念的应用和分布的困难,各自的编码能力的学生。
The analysis of source code produced by novice programmers could provide interesting insights into their learning progress, particularly in introductory programming courses. Yet, as the programming ability of a person is assumed to be quite complex, it is not likely that it would be observable directly in its total. Instead, we regard those abilities as latent psychometric constructs and apply the methodology of item response theory (IRT) to assess their manifestations. In preparatory work, we had identified a list of items that represent the central concepts of object-oriented programming. In this paper we propose a methodology that allows the evaluation of coding abilities by analyzing the application of those concepts. We demonstrate this methodology by exemplarily analyzing source code that was produced during programming projects. The results provide interesting information about the difficulty of the concepts' application and the distribution of the respective coding abilities among the students.
DOI: 10.1093/schbul/sbu013
发表时间: 2014-05-01
影响因子: 6.6
作者:
Reilly, James L.;Sweeney, John A.
通讯作者: Sweeney, John A.