UKP-SQuARE: A Software Platform for Question Answering Research

UKP-SQuARE：问答研究软件平台

• 批准号: 443179992
• 负责人: Professorin Dr. Iryna Gurevych
• 金额: --
• 依托单位: Fachgebiet Ubiquitäre Wissensverarbeitung
• 依托单位国家: 德国
• 项目类别: Research Grants
• 资助国家: 德国
• 项目状态: 未结题
• 来源: https://gepris.dfg.de/gepris/projekt/443179992?language=en
• 关键词: UKP; SQuARE; Software; Platform; Question

The number of use-cases that can be addressed by means of automatic question answering (QA) has exploded over the past years. End-to-end QA systems play a crucial role in enabling researchers to analyse the real-world performances of their models in these different scenarios. However, to date, QA systems and frameworks are limited to certain types of QA pipelines, and they are not reusable across diverse kinds of QA.In this project, we will address this issue by creating UKP-SQuARE, a reusable open-source QA platform that will allow researchers to seamlessly integrate novel approaches to different kinds of QA. UKP-SQuARE will include extensible components to retrieve web documents or knowledge-base information, a QA model repository to easily replace trained models during run-time, and a web-UI that can render explanations for model decisions. A QA skill system will finally enable researchers to integrate multiple interoperable approaches to different kinds of QA into one unified system. We will achieve this by consolidating the research prototypes from our DFG-funded project QA-EduInf for knowledge-base QA (KB-QA) and community-based QA (cQA). This will ensure the long-term preservation and the impact of our project results well beyond cQA and KB-QA.For the quality assurance of UKP-SQuARE, we will substantially involve the research community in the development process. We will moderate an open-source development community, provide detailed documentation and developer guides, and hold regular workshops with leading QA researchers. Furthermore, our public system demonstration will provide an extensive example of our platform in a real-world environment. Finally, we will integrate claim validation as a novel kind of QA in our platform to verify UKP-SQuARE’s extensibility, and its potential use in joint studies with other research fields such as social sciences.

在过去的几年中，可以通过自动问答（QA）来解决的用例数量。端到端的质量检查系统在使研究人员能够在这些不同的情况下分析其模型的现实性能方面起着至关重要的作用。但是，迄今为止，质量保证系统和框架仅限于某些类型的质量检查管道，并且在潜水员的QA中不可重复使用。在该项目中，我们将通过创建UKP-Square来解决这个问题，UKP-Square（可重复使用的开放源QA平台）将允许研究人员无缝地将新颖的方法集成到不同种类的QA。 UKP-Square将包括可扩展的组件来检索Web文档或知识基础信息，QA模型存储库在运行时易于替换训练有素的模型，以及可以为模型决策提供解释的Web-UI。质量保证技能系统最终将使研究人员能够将多种可互操作方法集成到不同种类的质量检查中。我们将通过合并DFG资助的QA-EDUINF的知识基本质量质量质量质量质量药（KB-QA）和基于社区的QA（CQA）的研究原型来实现这一目标。这将确保长期准备和我们项目的影响远远超出了CQA和KB-QA。对于UKP平方英尺的质量保证，我们将大大涉及研究社区的发展过程。我们将安排一个开源开发社区，提供详细的文档和开发人员指南，并与领先的QA研究人员定期举办研讨会。此外，我们的公共系统演示将为我们在现实世界中的环境中提供一个广泛的例子。最后，我们将在平台中将索赔验证作为一种新型的质量保证，以验证UKP-Square的可扩展性及其在与其他研究领域（例如社会科学）的联合研究中的潜在使用。