Reproducing Real World Acoustics in Virtual Reality UsingSpherical Cameras

Reproducing Real World Acoustics in Virtual Reality UsingSpherical Cameras
复制标题

使用球形相机在虚拟现实中再现真实世界的声学效果

DOI：
--
复制
发表时间：
2019
期刊：
影响因子：
--
通讯作者：
A. Hilton
A. Hilton
中科院分区：
--
文献类型：
--
作者：
Luca Remaggi;Hansung Kim;P. Jackson;A. Hilton

文献摘要

被引文献

相似文献

虚拟现实（VR）系统已经得到了热烈的探索，有几个研究团体正在研究
Virtual Reality (VR) systems have been intensely explored, with several research communities investigating the different modalities involved. Regarding the audio modality, one of the main issues is the generation of sound that is perceptually coherent with the visual reproduction. Here, we propose a pipeline for creating plausible interactive reverb using visual information: first, we characterize real environment acoustics given a pair of spherical cameras; then, we reproduce reverberant spatial sound, by using the estimated acoustics, within a VR scene. The evaluation is made by extracting the room impulse responses (RIRs) of four virtually rendered rooms. Results show agreement, in terms of objective metrics, between the synthesized acoustics and the ones calculated from RIRs recorded within the respective real rooms.