Handling Information Access Dialogue through QA Technologies - A novel challenge for open-domain question answering
Handling Information Access Dialogue through QA Technologies - A novel challenge for open-domain question answering
复制标题
DOI：
--
复制
发表时间：
2004
期刊：
影响因子：
--
通讯作者：
Tsuneaki Kato;Jun-ichi Fukumoto;Fumito Masui;N. Kando
中科院分区：
文献类型：
--
作者：
Tsuneaki Kato;Jun-ichi Fukumoto;Fumito Masui;N. Kando
提出了一种新的评估开放域问答技术的挑战。在这个挑战中，问答系统应该被交互地用来回答一系列相关的问题，而在传统的设置中，系统一个接一个地回答孤立的问题。这种交互发生在为特定主题的报告收集信息的情况下，或者在浏览用户感兴趣的信息时。在本文中，首先，我们解释了挑战的设计。然后，我们讨论了它的现实，并显示了挑战所衡量的能力在实际情况中是如何有用和重要的，以及挑战的难度对于评估开放域问答技术的现状是合适的。
A novel challenge for evaluating open-domain question answering technologies is proposed. In this challenge, question answering systems are supposed to be used interactively to answer a series of related questions, whereas in the conventional setting, systems answer isolated questions one by one. Such an interaction occurs in the case of gathering information for a report on a specific topic, or when browsing information of interest to the user. In this paper, first, we explain the design of the challenge. We then discuss its reality and show how the capabilities measured by the challenge are useful and important in practical situations, and that the difficulty of the challenge is proper for evaluating the current state of open-domain question answering technologies.