Vehicle-ride sensation sharing system with stereoscopic 3D visual perception and vibro-vestibular feedback for immersive remote collaboration
Vehicle-ride sensation sharing system with stereoscopic 3D visual perception and vibro-vestibular feedback for immersive remote collaboration
复制标题
具有立体 3D 视觉感知和振动前庭反馈的车辆乘坐感觉共享系统，可实现沉浸式远程协作
DOI：
10.1080/01691864.2022.2129033
复制
发表时间：
2022
影响因子：
2
通讯作者：
Ikei Yasushi
中科院分区：
文献类型：
--
作者：
Yem Vibol;Nashiki Reon;Morita Tsubasa;Ikei Yasushi
在本研究中，我们使用个人车辆（即Segway）和轮椅式运动显示器，提出了一种车辆乘坐感觉共享系统，使本地乘客能够与远程驾驶员进行沉浸式协作。坐在运动显示器中的本地骑手可以同时获得3D视觉感知和振动前庭感觉。该系统的远程驾驶侧是通过在赛格威上安装两个360度摄像头和一个稳定器来捕获立体3D图像，并将它们发送到当地骑手佩戴的头戴式显示器的每只眼睛。通过将传统轮椅改装成一个简单、轻便的机构，由两个直流电机驱动和振动，我们为当地乘客开发了振动前庭显示器的原型。然后，我们研究了振动前庭轮椅的有效性。结果表明，轮椅的加速/减速与视觉提示成比例，可以显着减少约54%的虚拟现实（VR）眩晕，并将乘坐感提高约2.25倍。此外，我们在SIGGRAPH ASIA 2019上进行了为期3天的演示体验，89名参与者填写了与我们的系统验证相关的问卷。结果表明，轮椅的振动前庭反馈对使用移动车辆的远程协作很重要。
In this study, using a personal vehicle (i.e. Segway) and a wheelchair-type motion display, we proposed a vehicle-ride sensation sharing system to enable a local rider to collaborate with a remote driver immersively. The local rider sitting in the motion display can receive both the 3D visual perception and the vibro-vestibular sensation. The remote driver side of the system was developed by attaching the Segway with two 360-degree cameras and a stabilizer to capture stereoscopic 3D images and send them to each eye of a head-mounted display worn by a local rider. By modifying a conventional wheelchair with a simple, lightweight mechanism for actuation and vibration by two DC motors, we developed the prototype of the vibro-vestibular display for local riders. Then, we investigated the effectiveness of a vibro-vestibular wheelchair. The result showed that the acceleration/deceleration of the wheelchair proportional to that of visual cue could significantly reduce virtual reality (VR) sickness by approximately 54% and increase the sense of riding a vehicle by approximately 2.25 times. Moreover, we conducted a demo experience in SIGGRAPH ASIA 2019 for 3 days and 89 participants filled the questionnaire related to our system validation. The results suggested that vibro-vestibular feedback by the wheelchair is important for remote collaboration that uses a mobile vehicle.