Model-based design of multimodal interaction for augmented reality web applications
Model-based design of multimodal interaction for augmented reality web applications
复制标题
增强现实 Web 应用程序的多模态交互的基于模型的设计
DOI：
--
复制
发表时间：
2015
期刊：
影响因子：
--
通讯作者：
E. Pizzolato
中科院分区：
文献类型：
--
作者：
S. Feuerstack;Allan Oliveira;Mauro dos Santos Anjo;R. B. Araujo;E. Pizzolato
尽管增强现实（AR）在许多不同的应用领域中的使用越来越多，但实现支持是有限的，并且仍然由源代码级别的开发驱动。虽然已经努力克服这些限制，但在创作环境和用于为具有多模态控制的web创建AR界面的源代码级框架方法之间存在明显的差距。基于模型的交互设计可以提供支持，以填补创作环境和框架之间的这一差距。然而，据我们所知，声明式和模型驱动设计（MDD）尚未应用于广泛模式的AR界面建模。因此，本文提出了一种扩展的模型驱动的设计，以科普互动，其新奇在于介绍了一种建模方法，针对AR开发人员和设计师在他们的任务，设计新形式的互动，可以在以后使用的创作环境。为了验证我们的方法，我们演示了如何跨越现实的拖放交互可以建模为一个在线家具店。我们实现了一个基于手势的控制，以展示如何将新的控制模式添加到现有的基于MDD的设计中，以扩展交互功能。
Despite the increasing use of Augmented Reality (AR) in many different application areas, implementation support is limited and still driven by development at source-code level. Although efforts have been made to overcome these limitations, there is a clear gap between authoring environments and source code level framework approaches for creating AR interfaces for the web with multimodal control. Model-based design for interaction can offer support to fill this gap between authoring environments and frameworks. However, to the best of our knowledge, a declarative and model-driven design (MDD) has not yet been applied to model AR interfaces for a wide spectrum of modes. Thus, this paper presents an extension of the model-driven design to cope with interactors, whose novelty lies on the introduction of a modeling approach targeted at AR developers and designers in their task to design new forms of interactions that can be later used in authoring environments. To validate our approach, we demonstrate how a reality spanning Drag-and-Drop interaction can be modeled for an online furniture shop. And we implemented a gesture based control to show how new control modes can be added to an existing MDD-based design to extend the interaction capabilities.