RI: Small: Using Automatically Generated Paraphrases and Discriminative ASR Training to Author Robust Question-Answering Dialogue Systems

问答(QA)对话系统在虚拟角色的主要角色是回答人类用户提出的问题的广泛上下文中很有用。在基于QA的对话系统中，主要的口译任务可以被框架为将用户的问题与内容作者预期的一组问题进行匹配。这个项目首次调查了自动释义预期问题的方法如何帮助作者建立大量预期问题变体，从而有可能显著增强聊天和口语的口译稳健性。通过使用现有的虚拟患者对话系统和俄亥俄州哥伦布市COSI(科学与工业中心)科学博物馆的新虚拟指南对该项目进行评估，该项目将加强医学教育，并为参观博物馆的儿童提供一个鼓舞人心的科学行动范例。它还承诺提高教育软件和商业问答系统中常见问题的简答评分的有效性。该方法首次探索了高级自动释义技术的潜力，以增强易于作者创作的问答对话系统中口译的稳健性。通过在内容创作时使用释义，可以利用和明确作者对功能等价问题空间的知识，潜在地导致口译精度的显著提高；此外，这样做使得有可能为自动语音识别(ASR)训练建立有效的、与任务相关的辨别空间。为了生成释义，该项目使用基于语法的表层实现器OpenCCG进行词汇句法转换，并使用广泛的覆盖资源、词义的向量空间模型和多词对齐。为了训练对问题解释有影响的区分ASR模型，生成的释义被纳入语义错误率估计。该项目使用从医科学生和博物馆参观者那里收集的数据，通过其对解释准确性和可用性的定性测量的影响来评估该方法。

Question-answering (QA) dialogue systems are useful in a broad range of contexts where the primary role of a virtual character is to answer questions posed by the human user. In QA-based dialogue systems, the primary interpretation task can be framed as matching a user's question against a set of questions anticipated by the content author. This project investigates for the first time how methods for automatically paraphrasing anticipated questions can aid authors in establishing a large set of expected question variants, making it possible to dramatically enhance interpretation robustness for both chatted and spoken language. By evaluating the project with an existing virtual patient dialogue system and new virtual guide for Columbus, Ohio's COSI (Center of Science and Industry) science museum, the project will enhance medical education and provide an inspirational example of science in action to the children who attend the museum. It also promises to enhance the effectiveness of short answer scoring in educational software and commercial QA systems for frequently asked questions.The proposed approach is the first to explore the potential of advanced automatic paraphrasing techniques to enhance the robustness of interpretation in an easy-to-author QA dialogue system. By employing paraphrasing at content authoring time, it becomes possible to take advantage of and make explicit the author's knowledge of the space of functionally equivalent questions, potentially leading to dramatic improvements in interpretation accuracy; furthermore, doing so makes it possible to set up an effective, task-relevant discrimination space for Automatic Speech Recognition (ASR) training. To generate paraphrases, the project uses the grammar-based surface realizer OpenCCG for lexico-syntactic alternations together with broad coverage resources, vector space models of word meaning and multiword alignments. To train discriminative ASR models that make a difference in question interpretation, generated paraphrases are incorporated into the semantic error rate estimation. Using data collected from medical students and museum visitors, the project assesses the approach via its impact on interpretation accuracy and qualitative measures of usability.