Automated capture and delivery of assistive task guidance with an eyewear computer: the GlaciAR system
Automated capture and delivery of assistive task guidance with an eyewear computer: the GlaciAR system
复制标题
使用眼镜计算机自动捕获和提供辅助任务指导：GlaciAR 系统
DOI：
--
复制
发表时间：
2016
期刊：
影响因子：
--
通讯作者：
W. Mayol
中科院分区：
文献类型：
--
作者：
T. Leelasawassuk;D. Damen;W. Mayol
在本文中，我们描述和评估一个辅助混合现实系统，旨在通过将自动化和无监督的信息收集与微创视频指南相结合来增强用户的任务。其结果是一个完全独立的系统，我们称之为GlaciAR（增强现实的眼镜上下文交互）。它通过从观察用户执行的操作中提取上下文交互来操作。GlaciAR能够i）基于头部运动注意力模型自动确定相关时刻，ii）自动生成视频指导信息，iii）基于对象检测方法触发这些指导，iv）通过观察多个用户而无需监督进行学习，以及v）完全在当前眼镜计算机（Google Glass）上运行。我们描述了GlaciAR的组成部分以及三个任务的用户评估。我们认为这项工作是朝着扩大在引导系统中众所周知的困难创作问题迈出的第一步，并探索通过微创视觉提示来增强用户的自然能力。
In this paper we describe and evaluate an assistive mixed reality system that aims to augment users in tasks by combining automated and unsupervised information collection with minimally invasive video guides. The result is a fully self-contained system that we call GlaciAR (Glass-enabled Contextual Interactions for Augmented Reality). It operates by extracting contextual interactions from observing users performing actions. GlaciAR is able to i) automatically determine moments of relevance based on a head motion attention model, ii) automatically produce video guidance information, iii) trigger these guides based on an object detection method, iv) learn without supervision from observing multiple users and v) operate fully on-board a current eyewear computer (Google Glass). We describe the components of GlaciAR together with user evaluations on three tasks. We see this work as a first step toward scaling up the notoriously difficult authoring problem in guidance systems and an exploration of enhancing user natural abilities via minimally invasive visual cues.