Sound Synthesis and Evaluation of Interactive Footsteps and Environmental Sounds Rendering for Virtual Reality Applications
Sound Synthesis and Evaluation of Interactive Footsteps and Environmental Sounds Rendering for Virtual Reality Applications
复制标题
DOI：
10.1109/tvcg.2011.30
复制
发表时间：
2011-09-01
影响因子：
5.2
通讯作者：
Serafin, Stefania
中科院分区：
文献类型：
--
作者：
Nordahl, Rolf;Turchet, Luca;Serafin, Stefania
我们提出了一个系统，提供实时声音合成的脚步声在不同的材料。该系统以麦克风为基础，可以探测到受试者的真实脚步声，并据此估计地面反作用力（GRF）。这种GRF用于控制基于物理模型的声音合成引擎。进行了两个实验。在第一个实验中，研究人员评估了受试者对所接触物体表面的识别能力。在第二个实验中，声音合成引擎被环境声音增强。结果表明，在某些情况下，添加声景可以显著提高对模拟环境的识别能力。
We propose a system that affords real-time sound synthesis of footsteps on different materials. The system is based on microphones, which detect real footstep sounds from subjects, from which the ground reaction force (GRF) is estimated. Such GRF is used to control a sound synthesis engine based on physical models. Two experiments were conducted. In the first experiment, the ability of subjects to recognize the surface they were exposed to was assessed. In the second experiment, the sound synthesis engine was enhanced with environmental sounds. Results show that, in some conditions, adding a soundscape significantly improves the recognition of the simulated environment.