Sound source localization with varying amount of visual information in virtual reality
Sound source localization with varying amount of visual information in virtual reality
复制标题
DOI：
10.1371/journal.pone.0214603
复制
发表时间：
2019-03-29
期刊：
影响因子：
3.7
通讯作者：
Dau, Torsten
中科院分区：
文献类型：
--
作者：
Ahrens, Axel;Lund, Kasper Duemose;Dau, Torsten
为了获得准确的空间听觉感知，受试者通常需要个人头部相关传递功能（hrtf）和头部运动的自由。基于扬声器的虚拟声音环境允许现实主义没有个性化的测量。为了研究现实环境中的视听感知，将空间跟踪头戴式显示器（hmd）（也称为虚拟现实眼镜）与虚拟声音环境相结合可能是有价值的。然而，hmd最近被证明会影响受试者的hrtf，从而可能影响声音定位的表现。此外，由于视觉信息在头戴式显示器上复制的局限性，视听感知可能受到影响。在这里，一个声音定位实验在有和没有HMD的情况下进行，并向受试者提供不同数量的视觉信息。此外，我们还分析了由HMD引起的声间时间和电平差误差（ITDs和ILDs）以及频谱扰动，并将其与感知定位数据进行了比较。结果显示，当受试者戴上头戴式头盔和蒙上眼睛时，定位精度会降低。发现hmd引起的方位定位误差在左半球大于右半球。当提供有限源位置集的视觉信息时，发现HMD引起的定位误差可以忽略不计。呈现手的位置和房间尺寸的视觉信息比没有视觉信息的情况下表现出更好的声音定位性能。增加可能的源位置进一步提高了定位精度。此外，以虚拟激光笔的形式添加指向反馈提高了仰角感知的精度，但没有提高方位角感知的精度。
To achieve accurate spatial auditory perception, subjects typically require personal head-related transfer functions (HRTFs) and the freedom for head movements. Loudspeaker-based virtual sound environments allow for realism without individualized measurements. To study audio-visual perception in realistic environments, the combination of spatially tracked head mounted displays (HMDs), also known as virtual reality glasses, and virtual sound environments may be valuable. However, HMDs were recently shown to affect the subjects' HRTFs and thus might influence sound localization performance. Furthermore, due to limitations of the reproduction of visual information on the HMD, audio-visual perception might be influenced. Here, a sound localization experiment was conducted both with and without an HMD and with a varying amount of visual information provided to the subjects. Furthermore, interaural time and level difference errors (ITDs and ILDs) as well as spectral perturbations induced by the HMD were analyzed and compared to the perceptual localization data. The results showed a reduction of the localization accuracy when the subjects were wearing an HMD and when they were blindfolded. The HMD-induced error in azimuth localization was found to be larger in the left than in the right hemisphere. When visual information of the limited set of source locations was provided, the localization error induced by the HMD was found to be negligible. Presenting visual information of hand-location and room dimensions showed better sound localization performance compared to the condition with no visual information. The addition of possible source locations further improved the localization accuracy. Also adding pointing feedback in form of a virtual laser pointer improved the accuracy of elevation perception but not of azimuth perception.