Spatio-temporal reasoning in mixed reality with a hybrid approach to support scalability and development of virtuality-reality continnum software

混合现实中的时空推理，采用混合方法来支持虚拟现实连续体软件的可扩展性和开发

• 批准号: 577627-2022
• 负责人: GouinVallerand, CharlesC
• 金额: $ 2.73万
• 依托单位: Université de Sherbrooke
• 依托单位国家: 加拿大
• 项目类别: Alliance Grants
• 财政年份: 2022
• 资助国家: 加拿大
• 起止时间: 2022-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=765834
• 关键词: Spatio; temporal; reasoning; mixed; reality

Recent advances in technology have led to the introduction of a new class of computing devices that combine computer-generated information with the "physical" world in a reality-virtuality continuum, such as Mixed Reality (MR). MR relies on contextual information to integrate virtual content within the physical environment and recognize users' actions to foster intuitive and natural interactions. In this project, we work on a first challenge in MR which resides in improving spatiotemporal reasoning by recognizing objects in a 3D world and tracking them while the users interact in a reality-virtuality continuum. As a second challenge, we will work in supporting the knowledge transfers and the construction of a common representation of an environment in MR between several users and several local or remote physical spaces. The expected results of the project will consist in algorithms and models for MR that will be implemented in two MR based context-aware decision support application prototypes for the Industry 4.0 and healthcare, as well as experimental results collected during in labs and on the field tests with potential users in Industry 4.0 and healthcare. The industry partner in this project is VMware Canada, a leader in intelligent multi-cloud ecosystems. It is expected that the use case of Mixed Reality, which is considered in this project, will play a pivotal role in the next generation - namely 6G - of mobile networks, which is one of the key research areas for the VMWare Distributed Edge (DE). The research conducted in this project to enhance Mixed Reality experiences, its scability and its demonstration (in Industry 4.0 and in healthcare) in a jointly identified infrastructure is therefore of utmost interest for VMware.

技术的最新进展已经导致引入了一类新的计算设备，其将计算机生成的信息与现实-虚拟连续体中的“物理”世界进行联合收割机组合，诸如混合现实（MR）。MR依赖于上下文信息来将虚拟内容集成到物理环境中，并识别用户的动作以促进直观和自然的交互。在这个项目中，我们致力于MR的第一个挑战，即通过识别3D世界中的对象并在用户在现实-虚拟连续体中交互时跟踪它们来改善时空推理。作为第二个挑战，我们将致力于支持知识转移，并在多个用户和多个本地或远程物理空间之间构建MR环境的通用表示。该项目的预期结果将包括MR的算法和模型，这些算法和模型将在工业4.0和医疗保健的两个基于MR的上下文感知决策支持应用原型中实现，以及在实验室和工业4.0和医疗保健潜在用户的现场测试中收集的实验结果。该项目的行业合作伙伴是VMware Canada，它是智能多云生态系统的领导者。预计该项目中考虑的混合现实用例将在下一代移动的网络（即6 G）中发挥关键作用，这是VMWare分布式边缘（DE）的关键研究领域之一。因此，VMware对该项目进行的研究非常感兴趣，该项目旨在增强混合现实体验、其可扩展性以及在联合确定的基础设施中的演示（在工业4.0和医疗保健领域）。