Mapping a Virtual View to the Physical World to Guide the Completion of Complex Task Sequences
Mapping a Virtual View to the Physical World to Guide the Completion of Complex Task Sequences
复制标题
将虚拟视图映射到物理世界以指导复杂任务序列的完成
DOI：
--
复制
发表时间：
2019
期刊：
影响因子：
--
通讯作者：
Shivakumar Sastry
中科院分区：
文献类型：
--
作者：
Bach Tran;Shivakumar Sastry
设计用于长时间运行的系统的维护需要精确执行复杂的任务序列。这种维护活动是昂贵的，需要在培训费用上进行大量投资。我们提出了一种利用增强现实（AR）来指导完成此类复杂任务序列的方法。该系统提供实时系统状态，并指导操作员完成任务序列。这种系统的关键要求之一是能够在AR设备中查看物理世界的对象和工件时对其进行注释。我们的新方法依赖于工程系统的CAD模型，而不是使用基于计算机视觉的计算密集型方法。在我们的方法中，我们将用户在虚拟世界中的凝视点转换为三维CAD模型中的相应坐标。3D CAD模型中的高分辨率细节使我们能够提取并呈现适当的注释。在未来，这种方法可以通过设计智能方法来显著增强，以自动生成指导完成复杂任务序列所需的AR内容。
The upkeep of systems that are designed to operate over long periods of time requires the precise execution of complex sequences of tasks. Such maintenance activities are expensive and require large investments in training costs. We present an approach that leverages Augmented Reality (AR) to guide the completion of such complex task sequences. This system presents real-time system-status and guidance to operators to complete the task sequences. One of the critical requirements in such a system is the ability to annotate objects and artifacts of the physical world when they are viewed in an AR device. Instead of using computationally intensive approaches based on computer vision, our novel approach relies on a CAD model of the engineered system. In our approach, we transform the gaze point of the user in the virtual world to corresponding coordinates in a 3D CAD model. The high-resolution details of in the 3D CAD model allows us to extract and present appropriate annotations. In the future, this approach can be significantly enhanced by designed intelligent methods to automatically generate the AR content necessary to guide the completion of complex task sequences.