It Sounds Cool: Exploring Sonification of Mid-Air Haptic Textures Exploration on Texture Judgments, Body Perception, and Motor Behaviour.

It Sounds Cool: Exploring Sonification of Mid-Air Haptic Textures Exploration on Texture Judgments, Body Perception, and Motor Behaviour.
复制标题

听起来很酷:探索空中触觉纹理的声音化对纹理判断、身体感知和运动行为的探索。

DOI:
10.1109/toh.2023.3320492
复制
发表时间:
2023
影响因子:
2.9
通讯作者:
Montano-Murillo R
Montano-Murillo R
中科院分区:
计算机科学3区
文献类型:
--
作者:
Montano-Murillo R

文献摘要

参考文献

被引文献

相似文献

超声波半空触觉技术允许将纹理表面感知地渲染到用户的手中。然而,与真实的纹理表面不同,半空中的触觉反馈缺乏可靠地推断纹理属性(例如,其粗糙度)所需的隐含的多感觉线索。在本文中,我们将半空中的触觉纹理与一致的声音反馈结合起来,研究发声如何影响人们对纹理属性的外显判断,2)对自己手的外显感觉,以及3)在触觉探索过程中的内隐运动行为。我们的结果表明,音频提示(单独呈现或与触觉结合)影响了参与者对纹理属性(粗糙、硬度、水分和粘度)的判断,产生了一些手感(手更光滑、更柔软、更松散、更灵活、更冷、更潮湿、更自然),并改变了参与者在探索纹理时的速度(移动得更快或更慢)。然后,我们进行了主成分分析,以更好地理解和可视化发现的结果,并以简短的讨论结束,讨论如何使用音频-触觉关联来在虚拟世界中的新兴应用场景中创造体验。
Ultrasonic mid-air haptic technology allows for the perceptual rendering of textured surfaces onto the user's hand. Unlike real textured surfaces, however, mid-air haptic feedback lacks implicit multisensory cues needed to reliably infer a texture's attributes (e.g., its roughness). In this article, we combined mid-air haptic textures with congruent sound feedback to investigate how sonification could influence people's 1) explicit judgment of the texture attributes, 2) explicit sensations of their own hand, and 3) implicit motor behavior during haptic exploration. Our results showed that audio cues (presented solely or combined with haptics) influenced participants' judgment of the texture attributes (roughness, hardness, moisture and viscosity), produced some hand sensations (the feeling of having a hand smoother, softer, looser, more flexible, colder, wetter and more natural), and changed participants' speed (moving faster or slower) while exploring the texture. We then conducted a principal component analysis to better understand and visualize the found results and conclude with a short discussion on how audio-haptic associations can be used to create embodied experiences in emerging application scenarios in the metaverse.
我在雨中感知:视觉触觉空中刺激中的空间不协调可以激发 VR 用户的归属感
DOI: 10.1145/3290605.3300362
发表时间: 2019
期刊: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems
影响因子: --
作者:
D. Pittera;E. Gatti;Marianna Obrist
通讯作者: Marianna Obrist
DOI: 10.3389/fpsyg.2015.00689
发表时间: 2015
影响因子: 3.8
作者:
Tajadura-Jiménez A;Tsakiris M;Marquardt T;Bianchi-Berthouze N
通讯作者: Bianchi-Berthouze N
DOI: 10.1109/access.2016.2608835
发表时间: 2016-01-01
期刊: IEEE ACCESS
影响因子: 3.9
作者:
Korres, Georgios;Eid, Mohamad
通讯作者: Eid, Mohamad
Hasti:纹理交互的触觉和音频合成
DOI: --
发表时间: 2021
期刊: World Haptics Conference
影响因子: --
作者:
Sonny Chan;Chase Tymms;Nick Colonnese
通讯作者: Nick Colonnese
多感官体验:感官与技术的邂逅
DOI: --
发表时间: 2021
期刊: IFIP TC13 International Conference on Human-Computer Interaction
影响因子: --
作者:
Marianna Obrist
通讯作者: Marianna Obrist