Stereo Vision Based Sensory Substitution for the Visually Impaired
Stereo Vision Based Sensory Substitution for the Visually Impaired
复制标题
DOI：
10.3390/s19122771
复制
发表时间：
2019-06-02
期刊：
影响因子：
3.9
通讯作者：
Herghelegiu, Paul
中科院分区：
文献类型：
--
作者：
Caraiman, Simona;Zvoristeanu, Otilia;Herghelegiu, Paul
开发基于计算机视觉的系统，致力于帮助视障人士感知环境、定位和导航，是近年来许多工作的主要研究课题。已经使用了大量资源来支持开发感官替代装置和电子旅行辅助设备，以帮助视障人士康复。视觉之声(SOV)项目使用了一种全面的方法来开发这样的SSD，解决了迄今为止限制目标受众大规模采用此类系统的所有具有挑战性的方面：可穿戴性、实时操作、普及性、可用性和成本。本文旨在介绍SOV SSD中基于人工视觉的组件，该组件在室外环境中执行场景重建和分割。与系统从结构光相机获取深度输入的室内用例不同，在室外SOV依靠立体视觉来检测感兴趣的元素并向用户提供环境的音频和/或触觉表示。我们的基于立体的方法旨在与可穿戴式采集设备配合使用，在立体对应的深度输入不可靠的情况下，以及头戴式相机复杂的6自由度运动的背景下，仍然提供实时、可靠的场景描述。我们在使用SOV摄像机获取的定制基准数据集上对我们的方法进行了定量评估，并为视障用户提供了可用性评估的亮点。
The development of computer vision based systems dedicated to help visually impaired people to perceive the environment, to orientate and navigate has been the main research subject of many works in the recent years. A significant ensemble of resources has been employed to support the development of sensory substitution devices (SSDs) and electronic travel aids for the rehabilitation of the visually impaired. The Sound of Vision (SoV) project used a comprehensive approach to develop such an SSD, tackling all the challenging aspects that so far restrained the large scale adoption of such systems by the intended audience: Wearability, real-time operation, pervasiveness, usability, cost. This article is set to present the artificial vision based component of the SoV SSD that performs the scene reconstruction and segmentation in outdoor environments. In contrast with the indoor use case, where the system acquires depth input from a structured light camera, in outdoors SoV relies on stereo vision to detect the elements of interest and provide an audio and/or haptic representation of the environment to the user. Our stereo-based method is designed to work with wearable acquisition devices and still provide a real-time, reliable description of the scene in the context of unreliable depth input from the stereo correspondence and of the complex 6 DOF motion of the head-worn camera. We quantitatively evaluate our approach on a custom benchmarking dataset acquired with SoV cameras and provide the highlights of the usability evaluation with visually impaired users.