Rapido: Prototyping Interactive AR Experiences through Programming by Demonstration
Rapido: Prototyping Interactive AR Experiences through Programming by Demonstration
复制标题
Rapido：通过演示编程构建交互式 AR 体验原型
DOI：
10.1145/3472749.3474774
复制
发表时间：
2021
期刊：
影响因子：
--
通讯作者：
P. Asente
中科院分区：
文献类型：
--
作者：
Germán Leiva;J. Grønbæk;C. Klokmose;Cuong Nguyen;Rubaiat Habib Kazi;P. Asente
通过演示编程（PbD）是一种众所周知的技术，它允许非程序员通过执行预期行为的示例来描述交互性，但尚未对AR进行广泛的探索。我们提出了Rapido，一种新颖的早期原型工具，可以使用PbD从非交互式视频原型创建完全交互式的移动AR原型。在Rapido中，设计师使用移动AR设备来记录视频原型，以捕获上下文，草图资产和演示交互。他们可以演示触摸输入，动画路径和规则，例如，有一个草图遵循设备的焦点区域或用户的世界空间触摸。同时，一个实时的网站可视化了所有演示示例的可编辑概述，并推断出用户流的状态机。我们的主要贡献是一种方法，使设计人员能够通过PbD将视频原型转换为可执行的状态机。设计师在这些表现形式之间切换，以交互方式完善最终的交互原型。我们通过三个流行的AR移动应用程序的主要交互原型来说明Rapido方法的强大功能。
Programming by Demonstration (PbD) is a well-known technique that allows non-programmers to describe interactivity by performing examples of the expected behavior, but it has not been extensively explored for AR. We present Rapido, a novel early-stage prototyping tool to create fully interactive mobile AR prototypes from non-interactive video prototypes using PbD. In Rapido, designers use a mobile AR device to record a video prototype to capture context, sketch assets, and demonstrate interactions. They can demonstrate touch inputs, animation paths, and rules to, e.g., have a sketch follow the focus area of the device or the user’s world-space touches. Simultaneously, a live website visualizes an editable overview of all the demonstrated examples and infers a state machine of the user flow. Our key contribution is a method that enables designers to turn a video prototype into an executable state machine through PbD. The designer switches between these representations to interactively refine the final interactive prototype. We illustrate the power of Rapido’s approach by prototyping the main interactions of three popular AR mobile applications.