Workshop on The Question Generation Shared Task and Evaluation Challenge

问题生成共享任务和评估挑战研讨会

• 批准号: 0836259
• 负责人: Vasile Rus
• 金额: --
• 依托单位: University of Memphis
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2008
• 资助国家: 美国
• 起止时间: 2008-06-01 至 2010-05-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0836259&HistoricalAwards=false
• 关键词: Workshop; Question; Generation; Shared; Task

The Workshop on the Question Generation Shared Task and Evaluation Challenge aims at establishing a community consensus with respect to various issues related to offering a shared task on Question Generation, including a clear definition of the main task and subtasks, data collection and annotation processes, data annotation schema, type of evaluation and evaluation metrics. The Natural Language Generation community has currently identified shared tasks as a potential venue to provide a focus of research in the field and increase the visibility of Natural Language Generation research in the wider Natural Language Processing/Computational Linguistics community. This award contributes to this effort by defining a novel shared task, the Question Generation task. The workshop organization is guided by the Desiderata for Evaluation of Natural Language Generation outlined at the recent NSF/SIGGEN Workshop on Shared Tasks and Comparative Evaluation in NLG held in 2007. The goal of a representative group of researchers from various areas of research (Natural Language Generation, Intelligent Tutoring Systems, Artificial Intelligence in Education) participating in the workshop discussions is to produce a to-do list for preparing and offering a Question Generation task at Generation Challenges 2010. A post-workshop report will outline the discussions and decisions of the workshop and will be made available to the research community. Due to the importance of Question Generation in learning technologies such as Intelligent Tutoring Systems, the workshop will have broader impact on improving the teaching and learning of STEM disciplines through improved educational software applications.

问题生成共享任务和评估挑战研讨会旨在就问题生成共享任务相关的各种问题建立社区共识，包括主任务和子任务的明确定义、数据收集和标注流程、数据标注模式、评估类型和评估指标。自然语言生成社区目前已将共享任务确定为一个潜在的场所，以提供该领域的研究重点，并提高自然语言生成研究在更广泛的自然语言处理/计算语言学社区中的知名度。该奖项通过定义一项新颖的共享任务，即问题生成任务，为这项工作做出了贡献。该研讨会的组织以 2007 年 NSF/SIGGEN 的 NLG 共享任务和比较评估研讨会上概述的自然语言生成评估需求为指导。来自不同研究领域（自然语言生成、智能辅导系统、教育人工智能）的代表性研究人员小组参与研讨会讨论的目标是制定一份待办事项清单，用于在 Generation 中准备和提供问题生成任务 2010 年的挑战。研讨会后报告将概述研讨会的讨论和决定，并将提供给研究界。由于问题生成在智能辅导系统等学习技术中的重要性，研讨会将通过改进教育软件应用程序对改善 STEM 学科的教学产生更广泛的影响。