Workshop on The Question Generation Shared Task and Evaluation Challenge

问题生成共同任务和评价挑战讲习班旨在就与提供共同问题生成任务有关的各种问题达成社区共识，包括明确界定主要任务和子任务、数据收集和注释过程、数据注释模式、评价类型和评价衡量标准。自然语言生成社区目前已将共享任务确定为一个潜在的场所，以提供该领域研究的重点，并提高自然语言生成研究在更广泛的自然语言处理/计算语言学社区中的能见度。该奖项通过定义一个新颖的共享任务，即问题生成任务，为这一努力做出了贡献。讲习班的组织是在2007年举行的NSF/SIGGEN关于NLG分担任务和比较评价的研讨会上概述的《自然语言生成评价需求》的指导下举办的。参加研讨会讨论的来自不同研究领域(自然语言生成、智能辅导系统、教育中的人工智能)的具有代表性的研究人员小组的目标是制定一份待办事项清单，以便在2010年的新一代挑战中准备和提供问题生成任务。讲习班后报告将概述讲习班的讨论和决定，并将提供给研究界。由于问题生成在智能教学系统等学习技术中的重要性，研讨会将通过改进教育软件应用程序，对改善STEM学科的教与学产生更广泛的影响。

The Workshop on the Question Generation Shared Task and Evaluation Challenge aims at establishing a community consensus with respect to various issues related to offering a shared task on Question Generation, including a clear definition of the main task and subtasks, data collection and annotation processes, data annotation schema, type of evaluation and evaluation metrics. The Natural Language Generation community has currently identified shared tasks as a potential venue to provide a focus of research in the field and increase the visibility of Natural Language Generation research in the wider Natural Language Processing/Computational Linguistics community. This award contributes to this effort by defining a novel shared task, the Question Generation task. The workshop organization is guided by the Desiderata for Evaluation of Natural Language Generation outlined at the recent NSF/SIGGEN Workshop on Shared Tasks and Comparative Evaluation in NLG held in 2007. The goal of a representative group of researchers from various areas of research (Natural Language Generation, Intelligent Tutoring Systems, Artificial Intelligence in Education) participating in the workshop discussions is to produce a to-do list for preparing and offering a Question Generation task at Generation Challenges 2010. A post-workshop report will outline the discussions and decisions of the workshop and will be made available to the research community. Due to the importance of Question Generation in learning technologies such as Intelligent Tutoring Systems, the workshop will have broader impact on improving the teaching and learning of STEM disciplines through improved educational software applications.