Specification and evaluation of an assessment engine for educational games: Empowering educators with an assessment editor and a learning analytics dashboard
Specification and evaluation of an assessment engine for educational games: Empowering educators with an assessment editor and a learning analytics dashboard
复制标题
DOI：
10.1016/j.entcom.2018.07.003
复制
发表时间：
2018-08
期刊：
影响因子：
--
通讯作者：
Yaelle Chaudy;T. Connolly
中科院分区：
文献类型：
--
作者：
Yaelle Chaudy;T. Connolly
评估是任何教与学过程中至关重要的一个方面。教育游戏为评估提供了前景看好的优势；对学生的个性化反馈和自动化评估过程。然而，尽管许多教师都认为教育游戏可以提高动机、学习能力和记忆力，但很少有人愿意完全相信它是一种评估工具。我们认为，这种缺乏信任的主要原因有两个：教育工作者没有得到关于游戏玩法的足够信息，以及许多教育游戏以黑匣子的形式分发，教师无法修改。本文介绍了一个用于将游戏与其评估分离的评估引擎。它允许教师在分发后修改游戏的评估，并通过学习分析仪表板可视化游戏数据。31名教育工作者对该引擎进行了量化评估。调查结果总体上是非常积极的：评估编辑和学习分析仪表板都被评为有用和易于使用。评估还表明，有了参与机会，教育工作者更有可能相信游戏的评估。本文的结论是，教育工作者可以有效地使用Engage来修改教育游戏的评估，并将游戏数据可视化，并有助于增加他们对教育游戏作为评估工具的信任。
Assessment is a crucial aspect of any teaching and learning process. Educational games offer promising advantages for assessment; personalised feedback to students and automated assessment process. However, while many teachers agree that educational games increase motivation, learning and retention, few of them are ready to fully trust them as an assessment tool. We believe there are two main reasons for this lack of trust: educators are not given sufficient information about the gameplays, and many educational games are distributed as black-boxes, unmodifiable by teachers. This paper presents an assessment engine designed to separate a game and its assessment. It allows teachers to modify a game’s assessment after distribution and visualise gameplay data via a learning analytics dashboard. The engine was evaluated quantitatively by 31 educators. Findings were overall very positive: both the assessment editor and the learning analytics dashboard were rated useful and easy to use. The evaluation also indicates that, having access to EngAGe, educators would be more likely to trust a game’s assessment. This paper concludes that EngAGe can be used by educators effectively to modify educational games’ assessment and visualise gameplay data, and that it contributes to increasing their trust in educational games as an assessment tool.