EAGER: Shared Gaze in Collaborative Referring

在情境对话中，尽管人工智能体和它们的人类伙伴存在于一个共享的环境中，但它们对共享世界的知识和表征却存在显著差异。当缺少环境的共享基础时，合作伙伴之间的沟通变得更具挑战性。对于合作伙伴来说，单独使用语言来描述感兴趣的对象可能是困难和低效的。基于先前关于共同注意、协作和人类语言处理中眼睛注视的实证研究结果，我们假设眼睛注视在协调协作参考过程中起重要作用，特别是在共享环境表征不匹配的伙伴之间。基于这一假设，本探索性项目的目的是研究共享凝视在协作参考过程中的作用。这项探索性研究的早期资助旨在产生新的发现，研究共享凝视如何协调共享环境中不匹配的伙伴之间的协作参考行为。这些发现将为将凝视建模与协作话语结合到地面参考的计算方法和系统提供见解。收集到的数据将支持许多关于情境对话中语言加工的深入研究。

In situated dialogue, although artificial agents and their human partners are copresent in a shared environment, their knowledge and representation of the shared world are significantly different. When a shared basis of the environment is missing, communication between partners become more challenging. Language alone can be difficult and inefficient for partners to ground objects of interest. Motivated by previous empirical findings on eye gaze in joint attention, in collaboration, and in human language processing, our hypothesis is that eye gaze plays an important role in coordinating the collaborative referring process, especially between partners who have mismatched representations of their shared environment. Based on this hypothesis, the objective of this exploratory project is to examine the role of shared gaze in the collaborative referring process.This EArly Grant for Exploratory Research aims to generate new findings on how shared gaze coordinates the collaborative referring behaviors between partners with mismatched representation of the shared environment. These findings will provide insight to computational approaches and systems that combine gaze modeling with the collaborative discourse to ground references. The collected data will support many in-depth studies on language processing in situated dialogue.