Effects of Sensory Feedback and Collider Size on Reach-to-Grasp Coordination in Haptic-Free Virtual Reality
Effects of Sensory Feedback and Collider Size on Reach-to-Grasp Coordination in Haptic-Free Virtual Reality
复制标题
DOI：
10.3389/frvir.2021.648529
复制
发表时间：
2021-08-19
影响因子：
--
通讯作者：
Tunik, Eugene
中科院分区：
文献类型：
--
作者：
Furmanek, Mariusz P.;Mangalam, Madhur;Tunik, Eugene
技术进步和增加的访问已经促使采用基于头戴式显示器的虚拟现实（VR）用于神经科学研究、手工技能训练和神经康复。在虚拟环境（VE）中专注于手动交互的应用，特别是无触觉VR，严重依赖于虚拟手对象碰撞检测。需要了解与手-物体碰撞相关的多感官整合如何影响感知-动作动态和伸手抓握协调，以增强交互式VR的沉浸感。在这里，我们探讨了是否以及在何种程度上感官替代触觉反馈的手物体碰撞（视觉，音频，或视听）和碰撞器的大小（大小的球形指针代表指尖）影响达到把握运动学。在研究1中，视觉，听觉，或组合反馈进行了比较，作为感官替代品，以表明在达到掌握行动的虚拟对象的成功把握。在研究2中，参与者达到抓住虚拟物体使用不同直径的球形碰撞器，以测试虚拟碰撞器的大小是否影响达到把握。我们的数据表明，碰撞机的大小，但没有感觉反馈方式显着影响的抓持运动学。较大的对撞机导致较小的尺寸归一化峰孔径。我们讨论了这一发现的背景下，球形碰撞机的大小对虚拟物体的大小的感知可能产生的影响，因此对电机规划的影响达到把握。至关重要的是，达到把握时空协调模式是强大的感觉反馈方式和球形碰撞器的大小的操纵，这表明神经系统调整达到（运输）组件的变化，在把握（孔径）组件。这些结果对VR的研究、商业、工业和临床应用具有重要意义。
Technological advancements and increased access have prompted the adoption of head- mounted display based virtual reality (VR) for neuroscientific research, manual skill training, and neurological rehabilitation. Applications that focus on manual interaction within the virtual environment (VE), especially haptic-free VR, critically depend on virtual hand-object collision detection. Knowledge about how multisensory integration related to hand-object collisions affects perception-action dynamics and reach-to-grasp coordination is needed to enhance the immersiveness of interactive VR. Here, we explored whether and to what extent sensory substitution for haptic feedback of hand-object collision (visual, audio, or audiovisual) and collider size (size of spherical pointers representing the fingertips) influences reach-to-grasp kinematics. In Study 1, visual, auditory, or combined feedback were compared as sensory substitutes to indicate the successful grasp of a virtual object during reach-to-grasp actions. In Study 2, participants reached to grasp virtual objects using spherical colliders of different diameters to test if virtual collider size impacts reach-to-grasp. Our data indicate that collider size but not sensory feedback modality significantly affected the kinematics of grasping. Larger colliders led to a smaller size-normalized peak aperture. We discuss this finding in the context of a possible influence of spherical collider size on the perception of the virtual object's size and hence effects on motor planning of reach-to-grasp. Critically, reach-to-grasp spatiotemporal coordination patterns were robust to manipulations of sensory feedback modality and spherical collider size, suggesting that the nervous system adjusted the reach (transport) component commensurately to the changes in the grasp (aperture) component. These results have important implications for research, commercial, industrial, and clinical applications of VR.