APlausE-MR - Audiovisual Plausibility and Experience in Multi-Party Mixed Reality

APlausE-MR - 多方混合现实中的视听合理性和体验

• 批准号: 444831328
• 负责人: Professor Dr.-Ing. Karlheinz Brandenburg
• 金额: --
• 依托单位: Institut für Medientechnik
• 依托单位国家: 德国
• 项目类别: Priority Programmes
• 资助国家: 德国
• 项目状态: 未结题
• 来源: https://gepris.dfg.de/gepris/projekt/444831328?language=en
• 关键词: APlausE; MR; Audiovisual; Plausibility; Experience

APlausE-MR focuses on distributed multi-party mixed reality (MR) scenarios that involve groups of collocated and remote users. It is our hypothesis that realistic audiovisual virtual environments contribute mainly to the place illusion, the sense of being there, but that creating and maintaining the illusion of plausibility, the sensation of what is happening is real, also requires avatar representations that look, behave and sound credible. Here, the usage of participant representations based on 3D-video-capture will be compared to classic avatar-type representations. Furthermore, supporting the users’ natural interaction with the virtual environment and with each other promotes the credibility of the experience through joint perception. These factors mutually reinforce plausibility and can even compensate each other in case of imperfections. To validate this hypothesis our proposed research addresses three main challenges: (1) The development and integration of the audiovisual technologies that enable plausible communication within a group and between groups in virtual worlds, (2) the identification and qualification of factors influencing the plausibility of audiovisual experiences in multi-party IVEs and (3) the development of suitable evaluation methods and technologies for the analysis of user and group behavior in collocated and distributed audiovisual IVEs. The PhD students of this project will be supported by three research groups with significant expertise in multi-user virtual reality, immersive telepresence, highly realistic spatial audio experiences, and the assessment of the quality of experience in audiovisual environments and for multi-party communication.

APlausE-MR 专注于涉及多组并置远程用户的分布式多方混合现实 (MR) 场景。我们的假设是，现实的视听虚拟环境主要有助于场所错觉，即身临其境的感觉，但创造和维持似是而非的错觉，即对正在发生的事情的感觉是真实的，还需要外观、行为和声音可信的化身表征。在这里，基于 3D 视频捕获的参与者表示的使用将与经典的化身类型表示进行比较。此外，支持用户与虚拟环境以及彼此之间的自然交互可以通过联合感知提高体验的可信度。这些因素相互增强了合理性，甚至可以在不完美的情况下相互补偿。为了验证这一假设，我们提出的研究解决了三个主要挑战：(1) 视听技术的开发和集成，使虚拟世界中群体内部和群体之间的合理沟通成为可能；(2) 识别和限定影响多方 IVE 中视听体验可信度的因素；(3) 开发合适的评估方法和技术，用于分析虚拟世界中的用户和群体行为。 并置和分发视听 IVE。该项目的博士生将得到三个研究小组的支持，这些研究小组在多用户虚拟现实、沉浸式远程呈现、高度逼真的空间音频体验以及视听环境和多方通信的体验质量评估方面拥有丰富的专业知识。