Intuitive Environmental Perception Assistance for Blind Amputees Using Spatial Audio Rendering
Intuitive Environmental Perception Assistance for Blind Amputees Using Spatial Audio Rendering
复制标题
DOI：
10.1109/tmrb.2022.3146743
复制
发表时间：
2022-02-01
期刊：
影响因子：
--
通讯作者：
Chen, Dapeng
中科院分区：
文献类型：
--
作者：
Hu, Xuhui;Song, Aiguo;Chen, Dapeng
视觉和触觉是人类与环境相互作用的基本感觉系统。对于盲人截肢者来说，如何快速、直观地将环境信息传达给他们，是恢复他们日常生活能力的关键问题之一。受人类听觉定位能力的启发，我们构建了一个与现实几乎相同的虚拟场景，并在交互对象中同时添加了一个虚拟声源。利用空间音频渲染(SAR)的方法，可以实时逼真地模拟虚拟声源的三维运动。最后，研制了肌电假肢控制系统来辅助盲人截肢者的日常活动，并对合成孔径雷达和基于语音提示(VP)的路径引导方法进行了目标定位的Fitts定律测试，结果表明，合成孔径雷达显著提高了信息传输率。假肢控制试验结果表明，在恢复自然抓取路径的同时，合成孔径雷达比虚拟样机缩短了一半的完成时间。凭借直观和丰富的知觉优势，SAR展示了盲人截肢者重建控制和感觉回路的潜在应用。
Vision and touch are essential sensory systems for human to interact with the environment. For the blind amputees, how to quickly and intuitively convey the environmental information to them is one of the key issues for recovering their daily living ability. Inspired by the auditory localization ability of human, we constructed a virtual scene almost identical to reality, and concurrently added a virtual sound source to the interactive object. Leveraging the method of spatial audio rendering (SAR), the three-dimensional motion of the virtual sound source can be vividly simulated in real-time. Finally, a myoelectric prosthetic control system was developed to assist blind amputees in their daily activities, The Fitts' law test on target localization was conducted on both SAR and voice prompt (VP) based path guidance methods, the results indicate that SAR significantly improves the information transfer rate. The results of prosthetic control test show that SAR reduces the completion time by half than the VP, while restoring the natural grasping path. With the advantage of intuitive and rich perception, the SAR demonstrated the potential applications for blind amputees to reconstruct the control and sensory loops.