An Evaluation of an Augmented Reality Multimodal Interface Using Speech and Paddle Gestures
An Evaluation of an Augmented Reality Multimodal Interface Using Speech and Paddle Gestures
复制标题
使用语音和桨手势评估增强现实多模态界面
DOI：
--
复制
发表时间：
2006
期刊：
影响因子：
--
通讯作者：
H. Ko
中科院分区：
文献类型：
--
作者：
S. Irawati;S. Green;M. Billinghurst;Andreas Dünser;H. Ko
本文讨论了对增强现实(AR)多模式界面的评估，该界面使用组合的语音和划桨手势来与现实世界中的虚拟对象交互。简要描述了基于时间语义和领域语义相结合的AR多通道接口结构和多通道融合策略。然后，我们给出了一项用户研究的结果，比较了使用多模式输入和仅使用手势输入的结果。结果表明，语音和划桨手势的结合提高了用户交互的效率。最后，我们描述了一些对开发其他多通道AR接口的设计建议。
This paper discusses an evaluation of an augmented reality (AR) multimodal interface that uses combined speech and paddle gestures for interaction with virtual objects in the real world. We briefly describe our AR multimodal interface architecture and multimodal fusion strategies that are based on the combination of time-based and domain semantics. Then, we present the results from a user study comparing using multimodal input to using gesture input alone. The results show that a combination of speech and paddle gestures improves the efficiency of user interaction. Finally, we describe some design recommendations for developing other multimodal AR interfaces.