Bimodal perception of audio-visual material properties for virtual environments
Bimodal perception of audio-visual material properties for virtual environments
复制标题
虚拟环境视听材料属性的双模态感知
DOI：
10.1145/1658349.1658350
复制
发表时间：
2010
期刊：
影响因子：
--
通讯作者：
G. Drettakis
中科院分区：
文献类型：
--
作者：
Nicolas Bonneel;C. Suied;I. Viaud;G. Drettakis
在交互式虚拟环境中，音频和视觉材料属性的高质量渲染是非常重要的，因为令人信服地渲染的材料增加了真实感和沉浸感。我们研究了听觉和视觉刺激的细节水平如何在视听材料渲染质量的感知中相互作用。我们的研究是基于感知的材料歧视，当不同层次的细节模态合成的声音，和双向反射分布函数的图形。我们对两种不同的模型（Dragon和Bunny模型）和两种材料类型（塑料和黄金）进行了实验。结果表明，在材料相似性的感知听觉和视觉的细节水平之间的显着的相互作用，当比较近似的细节水平，以高质量的视听参考渲染。我们展示了如何这一结果可以有助于显着节省在交互式视听渲染系统的计算时间。据我们所知，这是第一个研究表明，在材料知觉任务中的音频和图形表示的相互作用。
High-quality rendering of both audio and visual material properties is very important in interactive virtual environments, since convincingly rendered materials increase realism and the sense of immersion. We studied how the level of detail of auditory and visual stimuli interact in the perception of audio-visual material rendering quality. Our study is based on perception of material discrimination, when varying the levels of detail of modal synthesis for sound, and bidirectional reflectance distribution functions for graphics. We performed an experiment for two different models (a Dragon and a Bunny model) and two material types (plastic and gold). The results show a significant interaction between auditory and visual level of detail in the perception of material similarity, when comparing approximate levels of detail to a high-quality audio-visual reference rendering. We show how this result can contribute to significant savings in computation time in an interactive audio-visual rendering system. To our knowledge, this is the first study that shows interaction of audio and graphics representation in a material perception task.