Influence of audio rendering in virtual environments on realism, presence, and socio-cognitive processing

虚拟环境中的音频渲染对真实感、临场感和社会认知处理的影响

• 批准号: 444832396
• 负责人: Professor Dr.-Ing. Matthias Blau
• 金额: --
• 依托单位: Institut für Hörtechnik und Audiologie
• 依托单位国家: 德国
• 项目类别: Priority Programmes
• 资助国家: 德国
• 项目状态: 未结题
• 来源: https://gepris.dfg.de/gepris/projekt/444832396?language=en
• 关键词: Influence; audio; rendering; virtual; environments

Interactive Virtual Environments (IVEs) provide unique new possibilities to study human perception and socio-cognitive processing in complex scenes. In IVEs, ecologically valid environmental conditions can be combined with a high degree of experimental control. Although researchers often included audio as a modality, the integration of highly realistic audio is still an exception. The overarching goal of this project is to identify the requirements regarding binaural audio rendering to achieve highly realistic audiovisual presentations of virtual social scenes and to characterize the effects of the audio rendering on (social) presence and socio-cognitive processes such as emotion, empathy, and (social) anxiety. Whereas in the first funding phase, the focus was on achieving the highest possible realism, in the second funding phase we will concentrate on characterizing the interaction between top-down effects and stimulus-related bottom-up effects in virtual social interaction scenarios on a self-report, behavioral, and on a neural level (measured via EEG). This interaction will be investigated by considering and analyzing expectations, emotion, familiarization, social stress, and presence as well as higher-order social cognition (e.g., empathy) in virtual social scenarios with different degrees of complexity regarding the binaural rendering in these scenarios: the (high realism) rendering developed in phase 1 is the starting point, which will be extended to multiple speech and non-speech auditorium-related sources as well as to a more advanced own-voice renderings in order to enable close-to-real-life interactive social scenes. Habituation and training, as well as alternatives to head-tracking, will be investigated to facilitate the use of audiovisual IVEs and to enable further clinical applications such as treating social anxiety disorders. Overall this project will contribute to better understand psychological and physiological processes and their functional relevance to provide plausible representations of real-life environments.

交互式虚拟环境（伊韦斯）为研究复杂场景中的人类感知和社会认知过程提供了独特的新可能性。在伊韦斯中，生态有效的环境条件可以与高度的实验控制相结合。虽然研究人员经常将音频作为一种模态，但高度逼真的音频的集成仍然是一个例外。该项目的总体目标是确定有关双耳音频渲染的要求，以实现虚拟社交场景的高度逼真的视听呈现，并表征音频渲染对（社交）存在和社会认知过程（如情感，同理心和（社交）焦虑）的影响。而在第一个资助阶段，重点是实现尽可能高的现实主义，在第二个资助阶段，我们将集中于表征自上而下的效果和刺激相关的自下而上的效果之间的相互作用，在虚拟社会互动场景的自我报告，行为和神经水平（通过脑电图测量）。这种互动将通过考虑和分析期望，情感，熟悉，社会压力和存在以及高阶社会认知（例如，移情）在虚拟社交场景中具有关于这些场景中的双耳渲染的不同程度的复杂性：在阶段1中开发的（高真实性）渲染是起点，其将被扩展到多个语音和非语音演播室相关的源以及更高级的自己的语音渲染，以便实现接近现实生活的交互式社交场景。习惯和培训，以及替代头部跟踪，将进行调查，以促进视听伊韦斯的使用，并使进一步的临床应用，如治疗社交焦虑症。总的来说，这个项目将有助于更好地理解心理和生理过程及其功能相关性，以提供真实生活环境的合理表示。