Interpreting Situated Dialogue Utterances: an Update Model that Uses Speech, Gaze, and Gesture Information

Interpreting Situated Dialogue Utterances: an Update Model that Uses Speech, Gaze, and Gesture Information
复制标题

解释情境对话话语:使用语音、注视和手势信息的更新模型

DOI:
--
复制
发表时间:
2013
期刊:
SIGDIAL Conference
影响因子:
--
通讯作者:
David Schlangen
David Schlangen
中科院分区:
--
文献类型:
--
作者:
C. Kennington;Spyros Kousidis;David Schlangen

文献摘要

被引文献

相似文献

在情景对话中,说话者共享时间和空间。我们提出了一个用于理解自然语言的统计模型,该模型以增量方式工作(即,在真实的共享时间中)并且被接地(即,链接到共享空间中的实体)。我们描述了我们的模型与一个例子,然后建立我们的模型工作良好的非情境,电话应用类型的话语,表明它是有效的接地语言在一个情境的环境,并进一步表明,它可以很好地利用体现线索,如凝视和指向在一个完全多模态的设置。
In situated dialogue, speakers share time and space. We present a statistical model for understanding natural language that works incrementally (i.e., in real, shared time) and is grounded (i.e., links to entities in the shared space). We describe our model with an example, then establish that our model works well on nonsituated, telephony application-type utterances, show that it is effective in grounding language in a situated environment, and further show that it can make good use of embodied cues such as gaze and pointing in a fully multi-modal setting.