The Eras and Trends of Automatic Short Answer Grading
The Eras and Trends of Automatic Short Answer Grading
复制标题
DOI：
10.1007/s40593-014-0026-8
复制
发表时间：
2015-03-01
影响因子：
4.9
通讯作者：
Stein, Benno
中科院分区：
文献类型：
--
作者：
Burrows, Steven;Gurevych, Iryna;Stein, Benno
自动简答评分（ASAG）是使用计算方法评估对客观问题的简短自然语言回答的任务。最近，这一领域的活跃研究大大增加，有80多篇论文符合ASAG的定义。然而，过去的努力一般都是临时性的，直到最近才具有可比性，因此需要对整个领域有一个统一的看法。本文的目标是解决这一目标，根据历史和组件的ASAG研究和系统的全面审查。我们的历史分析确定了35个ASAG系统在5个时间主题，标志着方法或评估的进步。相比之下，我们的成分分析从预处理到有效性回顾了6个常见维度。一个关键的结论是，评估的时代是ASAG研究的最新趋势，这为该领域的巩固铺平了道路。
Automatic short answer grading (ASAG) is the task of assessing short natural language responses to objective questions using computational methods. The active research in this field has increased enormously of late with over 80 papers fitting a definition of ASAG. However, the past efforts have generally been ad-hoc and non-comparable until recently, hence the need for a unified view of the whole field. The goal of this paper is to address this aim with a comprehensive review of ASAG research and systems according to history and components. Our historical analysis identifies 35 ASAG systems within 5 temporal themes that mark advancement in methodology or evaluation. In contrast, our component analysis reviews 6 common dimensions from preprocessing to effectiveness. A key conclusion is that an era of evaluation is the newest trend in ASAG research, which is paving the way for the consolidation of the field.