Automated competency measurement and feedback generation for object-oriented programming

面向对象编程的自动能力测量和反馈生成

• 批准号: 412374068
• 负责人: Professor Dr. Michael Goedicke
• 金额: --
• 依托单位: paluno - The Ruhr Institute for Software Technology
• 依托单位国家: 德国
• 项目类别: Research Grants
• 财政年份: 2019
• 资助国家: 德国
• 起止时间: 2018-12-31 至 2021-12-31
• 项目状态: 已结题
• 来源: https://gepris.dfg.de/gepris/projekt/412374068?language=en
• 关键词: Automated; competency; measurement; feedback; generation

Based on the course of the project so far, it has been possible to identify competence candidates through the didactic and empirical analysis of student programming code and in this way to link the automated analysis and evaluation of programming code as a solution to programming tasks with the evidence-based definition and measurement of competences for object-oriented programming. This lays the scientific foundation for creating corresponding assessment items and using them in teaching. Nevertheless, the successful use of these items requires the empirical validation of the competence candidates found so far and, in particular, the investigation of the effect of these items and the automatically generated, competence-oriented feedback based on them. In addition, the derivation of competence candidates can by no means be regarded as completed with the results so far, so that further competence candidates can and should be derived with the method successfully established during the project so far and associated items for competence measurement defined. The project thus pursues both didactic and educational technology goals. In the didactic part, the derivation of further competence candidates as well as the empirical validation of the found competence candidates are in the foreground, followed by the investigation of the mutual connection between automated feedback and the quality of the submitted solutions. The use of the items will generate extensive data that will allow conclusions to be drawn about knowledge gaps or misconceptions. The analysis of helpful feedback, in turn, will allow conclusions to be drawn about the nature and structure of the skills deficits that triggered the feedback, as well as about the quality and functioning of the items. Due to the project's duration of several years, a comparison of upcoming semesters and existing data sets will not only focus on short-term effects, but also on effects across semesters, in order to be able to observe wear-and-tear effects due to the use of identical tasks over several years. In the educational technology part of the objective, the focus is on the subject-specific further development of technical procedures, which concern both the support for the didactic analysis of large amounts of programme code and the automatic generation of specific, competence-oriented feedback. The aim is to automate the qualitative analysis of student programme code necessary for the didactic part to such an extent that mechanisms for recognising knowledge gaps, misconceptions and competence deficits can become an integral part of the e-assessment system JACK used and thus enable the further development of competence-oriented feedback beyond the end of the project term, especially in the everyday operation of a lecture.

根据到目前为止该项目的进程，可以通过对学生编程代码的说教和经验分析来确定候选能力，并以这种方式将作为编程任务解决方案的编程代码的自动分析和评估与面向对象编程的基于证据的能力定义和衡量联系起来。这为制定相应的测评项目并将其应用于教学奠定了科学基础。然而，这些项目的成功使用需要对迄今发现的能力候选人进行经验验证，特别是需要调查这些项目的影响以及根据这些项目自动生成的、以能力为导向的反馈。此外，不能认为到目前为止，能力候选人的推导工作已经完成，因此，可以而且应该用到目前为止在项目期间成功建立的方法来得出更多的能力候选人，并确定能力衡量的相关项目。因此，该项目既追求教学目标，也追求教育技术目标。在教学部分，进一步的能力候选的推导以及对所发现的能力候选的经验验证是重点，其次是调查自动反馈与提交的解决方案的质量之间的相互联系。这些项目的使用将产生大量数据，从而能够得出关于知识差距或误解的结论。反过来，对有益反馈的分析将使人们能够就触发反馈的技能缺陷的性质和结构以及项目的质量和功能得出结论。由于该项目的持续时间为数年，对即将到来的学期和现有数据集的比较不仅将侧重于短期影响，还将侧重于跨学期的影响，以便能够观察由于使用相同任务而在几年内产生的磨损影响。在目标的教育技术部分，重点是针对具体学科进一步制定技术程序，这既涉及支持对大量方案代码进行说教分析，也涉及自动生成面向能力的具体反馈意见。其目的是使教学部分所需的学生课程代码的定性分析自动化，以便识别知识差距、误解和能力缺陷的机制可以成为杰克使用的电子评估系统的组成部分，从而能够在项目学期结束后进一步发展以能力为导向的反馈，特别是在授课的日常操作中。