On the use of resubmissions in automatic assessment systems
On the use of resubmissions in automatic assessment systems
复制标题
关于自动评估系统中重新提交的使用
DOI：
10.1080/08993400600912426
复制
发表时间：
2006
影响因子：
2.7
通讯作者：
L. Malmi
中科院分区：
文献类型：
--
作者：
V. Karavirta;A. Korhonen;L. Malmi
自动评估系统通常支持对学习者提交的内容进行即时评分和响应。它们还允许学习者考虑反馈、修改和重新提交他们的解决方案。有几个战略可以实施重新提交政策。然而，最终的目标是改善学习结果，因此策略的目的应该是防止学习者不负责任地使用重新提交功能。这里的关键问题之一是如何开发该系统及其使用，以减少这种似乎不值得的重复？在这篇文章中，我们研究了从支持重新提交的自动评估系统收集的数据。我们使用聚类技术来区分似乎在使用重新提交功能和从练习中获得的分数方面不同的学习者群体。通过将这些群体相互比较，我们得出结论，对于一小部分学习者来说，他们存在着低效使用重新提交的风险。一些学习者似乎没有在两次连续提交之间考虑太多就重新提交了解决方案。为了防止这种漫无目的的反复试验解决问题的方法，一种选择是限制允许重新提交的次数。然而，并不是所有的重新提交都是糟糕的。此外，有几种方法可以认识到这些限制，以实现最适合所有学生的可能的重新提交政策。这些都是在研究过程中收集的证据的基础上讨论的。
Automatic assessment systems generally support immediate grading and response on learners' submissions. They also allow learners to consider the feedback, revise, and resubmit their solutions. Several strategies exist to implement the resubmission policy. The ultimate goal, however, is to improve the learning outcomes, and thus the strategies should aim at preventing learners from using the resubmission feature irresponsibly. One of the key questions here is how to develop the system and its use in order to cut down such reiteration that does not seem to be worthwhile? In this paper, we study data gathered from an automatic assessment system that supports resubmissions. We use a clustering technique to draw a distinction among learner groups that seem to differ in their use of the resubmission feature and the points achieved from the exercises. By comparing these groups with each other, we conclude that for a small minority of learners there is a risk that they use the resubmission inefficiently. Some learners seem to resubmit the solution without thinking much between two consecutive submissions. In order to prevent such an aimless trial-and-error problem solving method, one option is to limit the number of allowed resubmissions. However, not all resubmissions are bad. In addition, there exist several ways to realize the limitations to achieve the best possible resubmission policy fit for all the students. These are discussed based on the evidence gathered during the research.