Mixed-Reality Interfaces for Remote Collaboration

用于远程协作的混合现实界面

• 批准号: RGPIN-2017-04883
• 负责人: Tang, Anthony
• 金额: $ 0.98万
• 依托单位: University of Calgary
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2019
• 资助国家: 加拿大
• 起止时间: 2019-01-01 至 2020-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=675365
• 关键词: Mixed; Reality; Interfaces; Remote; Collaboration

Conventional video chat provides audio and video connection between distance-separated collaborators. But conventional video chat tools are inadequate for remote collaboration tasks that focus on objects and environments. Such remote collaboration tasks will increasingly become commonplace, including assistance tasks (e.g. machine repair), guidance tasks (e.g. remote tour), and inspection tasks (e.g. design critique). Conventional video chat does a poor job of giving collaborators: (i) awareness information about what a remote collaborator is doing, such as where they are looking, or the hand gestures they are making as part of speech (e.g. pointing while saying “Look at this one”), and (ii) an understanding of the remote space. These interfaces are critical, because remote objects and locations have become be the main focus of collaboration enabled by mobile devices.******We will explore how to design Mixed Reality (MR) interfaces to support remote collaboration tasks. Such interfaces typically do two things: first, they visually anchor virtual content in the real world using augmented reality (e.g. projected visuals, head-mounted displays, or see-through displays), and second, they use sensors to capture aspects of environment (e.g. a depth camera scan/video capture of an environment) or collaborators' interactions with the environment (e.g. their gestures or what they are looking at). We will produce theories and prototypes that describe and illustrate how to design MR interfaces that capture awareness information about collaborators (such as gaze, view and gesture information), and allow collaborators to independently explore a digital remote environment.******This program is comprised of three sub-projects:******(1) Software infrastructure. We will design and implement new infrastructure that allows us to rapidly prototype new kinds of MR experiences.******(2) Capturing and visualizing awareness information. Our MR prototypes will focus on capturing collaborators' interactions with the environment (e.g. where are they looking, what are they pointing at, etc.), representing and visualizing this to remote collaborators.******(3) Enabling independent exploration. We will explore ways of digitally capturing and reconstructing remote environments to allow collaborators to independently view and explore these spaces.******Our research will result in new knowledge about how to design and build MR interfaces that allow distance-separated collaborators to work together effectively. We will identify and address challenges that arise in this design space including user interface design, ease of use and fluidity, and technical infrastructure. Our work will inform the research community on designing effective MR interfaces for remote collaboration. It will inform Canadian companies as they continue to develop technologies for remote and telework scenarios.

传统的视频聊天提供了远距离协作者之间的音频和视频连接。但是，传统的视频聊天工具对于关注对象和环境的远程协作任务来说是不够的。这样的远程协作任务将变得越来越普遍，包括辅助任务（例如机器维修）、指导任务（例如远程游览）和检查任务（例如设计评论）。传统的视频聊天在为协作者提供以下方面做得很差：(i)关于远程协作者正在做什么的意识信息，例如他们在看哪里，或者他们作为讲话的一部分所做的手势（例如在说“看这个”时指着），以及（ii）对远程空间的理解。这些接口至关重要，因为远程对象和位置已成为移动设备支持的协作的主要焦点。******我们将探讨如何设计混合现实（MR）接口来支持远程协作任务。这样的接口通常做两件事：首先，它们使用增强现实技术在视觉上将虚拟内容锚定在现实世界中（例如投影视觉，头戴式显示器或透明显示器），其次，它们使用传感器捕捉环境的各个方面（例如深度相机扫描/环境的视频捕捉）或合作者与环境的互动（例如他们的手势或他们正在看的东西）。我们将产生理论和原型，描述和说明如何设计MR接口，捕获有关合作者的感知信息（如凝视，视图和手势信息），并允许合作者独立探索数字远程环境。******该计划由三个子项目组成：******(1)软件基础设施。我们将设计和实施新的基础设施，使我们能够快速构建新型MR体验的原型。******(2)捕获和可视化感知信息。我们的MR原型将专注于捕获协作者与环境的交互（例如，他们在看哪里，他们指着什么，等等），并将其表示和可视化给远程协作者。******(3)自主探索。我们将探索数字捕捉和重建远程环境的方法，使合作者能够独立地查看和探索这些空间。******我们的研究将产生关于如何设计和构建MR接口的新知识，使远程分离的合作者能够有效地协同工作。我们将识别和解决在这个设计领域出现的挑战，包括用户界面设计、易用性和流动性，以及技术基础设施。我们的工作将告知研究界如何设计有效的远程协作MR接口。它将为加拿大公司继续开发远程和远程工作场景的技术提供信息。