Analysing speech and co-speech gesture in constraint-based grammars

Analysing speech and co-speech gesture in constraint-based grammars
复制标题

基于约束的语法分析语音和共同语音手势

DOI：
--
复制
发表时间：
2010
期刊：
Proceedings of the International Conference on Head-Driven Phrase Structure Grammar
影响因子：
--
通讯作者：
A. Lascarides
A. Lascarides
中科院分区：
--
文献类型：
--
作者：
K. Alahverdzhieva;A. Lascarides

文献摘要

被引文献

相似文献

本文通过对多模态交际行为的形式-意义关系的分析， 结合语言输入和手势的语法。与语音不同，手势信号 只有通过它们与同步语音内容的语义关系才能解释。这种关系 用来解决仅由手势形式所揭示的不完整的意义。我们证明 通过使用标准的语言学方法，语音和手势可以以一种受约束的方式整合在一起， 转化为一个单一的派生树，映射到一个统一的含义表示。
This paper addresses the form-meaning relation of multimodal communicative actions by means of a grammar that combines verbal input with hand gestures. Unlike speech, gesture signals are interpretable only through their semantic relation to the synchronous speech content. This relation serves to resolve the incomplete meaning that is revealed by gestural form alone. We demonstrate that by using standard linguistic methods, speech and gesture can be integrated in a constrained way into a single derivation tree which maps to a uniform meaning representation.