Virtual Walking With Omnidirectional Movies and Foot Vibrations: Scene-Congruent Vibrations Enhance Walking-Related Sensations and Ground Material Perceptions
Virtual Walking With Omnidirectional Movies and Foot Vibrations: Scene-Congruent Vibrations Enhance Walking-Related Sensations and Ground Material Perceptions
复制标题
具有全方位电影和足部振动的虚拟行走：场景一致的振动增强与行走相关的感觉和地面材料感知
DOI：
10.1109/access.2021.3136557
复制
发表时间：
2021
期刊：
影响因子：
3.9
通讯作者：
Kitazaki Michiteru
中科院分区：
文献类型：
--
作者：
Nakamura Junya;Matsuda Yusuke;Amemiya Tomohiro;Ikei Yasushi;Kitazaki Michiteru
走路是人类的需要。即使身体残疾或社交场合，如COVID-19大流行，阻止人们行走，虚拟现实也可以为虚拟行走或旅行提供机会。在这项研究中，开发了一个虚拟行走系统，用户在观看全方位的电影，同时接收场景一致的振动，他们的左，右前脚和脚跟。脚的振动的时间产生的估计与视觉同步定位和映射（视觉SLAM）应用到四个全向电影的摄像机运动轨迹。为四个地面场景准备了一致的振动模式。调制步行相关的感觉和地面材料的看法一致和不一致的振动进行了验证，使用心理测量。结果表明，有节奏的足部振动改善了自我运动，行走，腿部动作和临场感的感觉，而与场景振动一致性无关。此外，一致的振动比不一致的振动行走相关的感觉和临场感在室内走廊和雪地场景。地面材料的感知被场景一致的振动增强，而被场景不一致的振动混淆。这些研究结果表明，振动模式不一定需要完全匹配的地面诱导虚拟行走的感觉，但是，场景一致或类似的振动改善虚拟行走的感觉和地面材料的感知。通过应用我们的方法，我们可以将各种公共全向电影转换成逼真的虚拟行走体验。
Walking is a human need. Even when physical disabilities or social situations, such as the COVID-19 pandemic, prevent people from walking, virtual reality can provide an opportunity for virtual walking or travel. In this study, a virtual walking system was developed in which users view omnidirectional movies while receiving scene-congruent vibrations to their left and right forefeet and heels. The timings of foot vibrations were generated by estimating the camera motion trajectory with visual simultaneous localization and mapping (visual SLAM) applied to four omnidirectional movies. Congruent vibration patterns were prepared for four ground scenes. Modulation of walking-related sensations and ground material perceptions by congruent and incongruent vibrations was verified using psychological measurements. The results showed that rhythmic foot vibration improved the sensations of self-motion, walking, leg action, and telepresence irrespective of scene–vibration congruency. Moreover, congruent vibrations were better than incongruent vibrations for walking-related sensations and telepresence in indoor corridors and snowy ground scenes. The perception of ground materials was enhanced by scene-congruent vibrations, whereas it was confused by scene-incongruent vibrations. These findings suggest that vibration patterns do not necessarily need to match the ground exactly to induce virtual walking sensations; however, scene-congruent or similar vibrations improve virtual walking sensations and ground material perception. By applying our methods, we can convert various public omnidirectional movies into realistic virtual walking experiences.