Hasti: Haptic and Audio Synthesis for Texture Interactions
Hasti: Haptic and Audio Synthesis for Texture Interactions
复制标题
Hasti：纹理交互的触觉和音频合成
DOI：
--
复制
发表时间：
2021
期刊：
影响因子：
--
通讯作者：
Nick Colonnese
中科院分区：
文献类型：
--
作者：
Sonny Chan;Chase Tymms;Nick Colonnese
多感官刺激可以极大地增强交互式虚拟环境的沉浸感。图形算法和VR显示器等技术的进步将交互式虚拟世界的外观推向了前所未有的逼真度，但渲染声音，特别是类似质量的触摸反馈仍然是一个挑战。我们描述了一种用于在三维虚拟环境中与纹理表面交互的振动触觉和音频刺激的实时合成方法。使用对象几何和材质属性的标准描述，包括通常用于基于物理的视觉渲染的位移和粗糙度纹理贴图，以生成与外观一致的逼真的声音和触摸反馈。我们的方法沿着接触轨迹重建苍蝇表面的细观和微观特征，并运行微接触动力学仿真，其输出驱动振动触觉执行器和模态声音合成。作为对我们的合成方法的初步评估，我们进行了一项探索性的、绝对识别的用户研究。
Multi-sensory stimuli can greatly enhance immersion in interactive virtual environments. Advances in graphics algorithms and technologies like VR displays have pushed the appearance of interactive virtual worlds to unprecedented fidelity, but rendering sound and, especially, touch feedback of comparable quality remains a challenge. We describe a method for real-time synthesis of vibrotactile haptic and audio stimuli for interactions with textured surfaces in 3-D virtual environments. Standard descriptions of object geometry and material properties, including displacement and roughness texture maps typically used for physically-based visual rendering, are employed to generate realistic sound and touch feedback consistent with appearance. Our method reconstructs meso-and microscopic surface features on the fly along a contact trajectory, and runs a micro-contact dynamics simulation whose outputs drive vibrotactile haptic actuators and modal sound synthesis. An exploratory, absolute identification user study was conducted as an initial evaluation of our synthesis methods.