Spatio-temporal reasoning in mixed reality with a hybrid approach to support scalability and development of virtuality-reality continnum software

混合现实中的时空推理，采用混合方法来支持虚拟现实连续体软件的可扩展性和开发

• 批准号: 577627-2022
• 负责人: GouinVallerand, CharlesC
• 金额: $ 2.73万
• 依托单位: Université de Sherbrooke
• 依托单位国家: 加拿大
• 项目类别: Alliance Grants
• 财政年份: 2022
• 资助国家: 加拿大
• 起止时间: 2022-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=765834
• 关键词: Spatio; temporal; reasoning; mixed; reality

Recent advances in technology have led to the introduction of a new class of computing devices that combine computer-generated information with the "physical" world in a reality-virtuality continuum, such as Mixed Reality (MR). MR relies on contextual information to integrate virtual content within the physical environment and recognize users' actions to foster intuitive and natural interactions. In this project, we work on a first challenge in MR which resides in improving spatiotemporal reasoning by recognizing objects in a 3D world and tracking them while the users interact in a reality-virtuality continuum. As a second challenge, we will work in supporting the knowledge transfers and the construction of a common representation of an environment in MR between several users and several local or remote physical spaces. The expected results of the project will consist in algorithms and models for MR that will be implemented in two MR based context-aware decision support application prototypes for the Industry 4.0 and healthcare, as well as experimental results collected during in labs and on the field tests with potential users in Industry 4.0 and healthcare. The industry partner in this project is VMware Canada, a leader in intelligent multi-cloud ecosystems. It is expected that the use case of Mixed Reality, which is considered in this project, will play a pivotal role in the next generation - namely 6G - of mobile networks, which is one of the key research areas for the VMWare Distributed Edge (DE). The research conducted in this project to enhance Mixed Reality experiences, its scability and its demonstration (in Industry 4.0 and in healthcare) in a jointly identified infrastructure is therefore of utmost interest for VMware.

最近的技术进步导致了新型计算设备的推出，这些设备将计算机生成的信息与现实-虚拟连续体中的“物理”世界相结合，例如混合现实 (MR)。 MR 依靠上下文信息将虚拟内容集成到物理环境中，并识别用户的操作以促进直观、自然的交互。在这个项目中，我们致力于解决 MR 的第一个挑战，即通过识别 3D 世界中的对象并在用户在现实-虚拟连续体中交互时跟踪它们来改进时空推理。第二个挑战是，我们将致力于支持知识转移以及在多个用户和多个本地或远程物理空间之间构建 MR 环境的通用表示。该项目的预期结果将包括用于工业 4.0 和医疗保健的两个基于 MR 的上下文感知决策支持应用程序原型中实施的 MR 算法和模型，以及在实验室和与工业 4.0 和医疗保健潜在用户进行现场测试期间收集的实验结果。该项目的行业合作伙伴是智能多云生态系统的领导者VMware Canada。预计该项目中考虑的混合现实用例将在下一代（即 6G）移动网络中发挥关键作用，这是 VMWare 分布式边缘 (DE) 的关键研究领域之一。因此，VMware 对在联合确定的基础设施中增强混合现实体验、其可扩展性及其演示（在工业 4.0 和医疗保健领域）进行的研究至关重要。