"Move the couch where?" : developing an augmented reality multimodal interface
"Move the couch where?" : developing an augmented reality multimodal interface
复制标题
“把沙发搬到哪里去？”
DOI：
10.1109/ismar.2006.297812
复制
发表时间：
2006
期刊：
影响因子：
--
通讯作者：
H. Ko
中科院分区：
文献类型：
--
作者：
S. Irawati;S. Green;M. Billinghurst;Andreas Dünser;H. Ko
本文描述了一种使用语音和桨手势进行交互的增强现实 (AR) 多模式界面。该应用程序允许用户结合语音和真实桨的手势，直观地在虚拟房间中布置虚拟家具。与其他多模态 AR 应用不同，多模态融合基于时间技术和语义技术的组合来消除用户语音和手势输入的歧义。我们描述了 AR 多模态界面架构，并讨论了如何通过考虑输入时间戳、对象属性和用户上下文，将多模态输入在语义上集成到单个解释中。
This paper describes an augmented reality (AR) multimodal interface that uses speech and paddle gestures for interaction. The application allows users to intuitively arrange virtual furniture in a virtual room using a combination of speech and gestures from a real paddle. Unlike other multimodal AR applications, the multimodal fusion is based on the combination of time-based and semantic techniques to disambiguate a users speech and gesture input. We describe our AR multimodal interface architecture and discuss how the multimodal inputs are semantically integrated into a single interpretation by considering the input time stamps, the object properties, and the user context.