Environmental Localization Mapping and Guidance for Visual Prosthesis Users

视觉假肢用户的环境定位测绘和指导

• 批准号: 10838685
• 负责人: Seth D Billings
• 金额: $ 9.94万
• 依托单位: JOHNS HOPKINS UNIVERSITY
• 依托单位国家: 美国
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-09-30 至 2024-07-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/10838685
• 关键词: Address; Administrative Supplement; Age related macular degeneration; American; Competence; Computer Vision Systems; Cues; Development; Devices; Disease; Effectiveness; Environment; Evaluation; FDA approved; Glaucoma; Goals; Implant; Lead; Learning; Legal Blindness; Life; Location; Maps; Modality; Ocular Prosthesis; Patients; Persons; Psyche structure; Research; Retinitis Pigmentosa; Semantics; Sensory; Societies; System; Systems Integration; Techniques; Technology; Testing; Time; Training; Update; Vision; Visual; Work; aged; auditory feedback; blind; falls; human subject; improved; innovation; legally blind; object recognition; parent grant; prosthesis wearer; prototype; retina implantation; retinal prosthesis; sensory feedback; smartphone application; synergism; visual information

Environmental Localization Mapping and Guidance for Visual Prosthesis Users Project Summary About 1.3 million Americans aged 40 and older are legally blind, a majority because of diseases with onset later in life, such as glaucoma and age-related macular degeneration. Second Sight developed the world’s first FDA approved retinal implant, Argus II, intended to restore some functional vision for people suffering from retinitis pigmentosa (RP). In this era of smart devices, generic navigation technology, such as GPS mapping apps for smartphones, can provide directions to help guide a blind user from point A to point B. However, these navigational aids do little to enable blind users to form an egocentric understanding of the surroundings, are not suited to navigation indoors, and do nothing to assist in avoiding obstacles to mobility. Prosthetic vision devices like the Argus II, on the other hand, provides blind users with a limited visual representation of their surroundings that improve users’ ability to orient themselves and traverse obstacles, yet lack features for high-level navigation and semantic interpretation of the surroundings. The proposed research aims to address these limitations through a synergy of state-of-the-art simultaneous localization and mapping (SLAM) and object recognition technologies. This proposal is driven by the hypothesis that navigation for users of retinal prosthetics can be greatly improved by incorporating SLAM and object recognition technology conveying environmental information via a retinal prosthesis and auditory feedback. SLAM enables the visual prosthesis system to construct a map of the user’s environment and locate the user within that map. The system then provides object location and navigational cues via appropriate sensory modalities enabling the user to mentally form an egocentric map of the environment. We have developed an advanced visual prosthesis system which 1) constructs a map of unfamiliar environments and localizes the user using SLAM technology 2) automatically identifies the structural semantics of the surroundings to determine navigationally-relevant obstacles and features and 3) provides sensory feedback for navigation, obstacle avoidance, and object/landmark identification. This project focuses on the completion of human subject testing of these capabilities.

视觉假体使用者的环境定位映射和指导 项目摘要 大约有130万年龄在40岁及以上的美国人在法律上是盲人，其中大多数是因为疾病 老年性黄斑变性的发病年龄较晚，如青光眼和老年性黄斑变性。Second Sight 开发了世界上第一个FDA批准的视网膜植入物，Argus II，旨在恢复一些 视网膜色素变性（RP）患者的功能性视力。 在这个智能设备的时代，通用导航技术，如GPS地图应用程序， 智能手机可以提供方向以帮助引导盲人用户从点A到点B。然而，在这方面， 这些导航辅助工具几乎不能使盲人用户形成对 周围环境，不适合在室内导航，并且不帮助避开障碍物 到流动性。另一方面，像Argus II这样的人工视觉设备为盲人用户提供了 对周围环境的有限视觉表示，提高用户定位自己的能力 和穿越障碍，但缺乏高层次导航和语义解释的功能， 四周拟议的研究旨在通过以下方面的协同作用来解决这些限制 最先进的同步定位和地图绘制（SLAM）和目标识别 技术. 该建议是由假设驱动的，即视网膜假体的用户的导航可以是 通过结合SLAM和对象识别技术， 环境信息通过视网膜假体和听觉反馈。SLAM使 视觉假体系统，用于构建用户环境的地图并在其中定位用户 那张地图然后，该系统通过适当的传感器提供对象位置和导航提示。 使用户能够在精神上形成环境的自我中心地图的模态。我们有 开发了一种先进的视觉假体系统，该系统1）构建了一个不熟悉的地图， 2）使用SLAM技术自动识别环境中的用户， 周围环境的结构语义，以确定导航相关的障碍物， 3）提供用于导航、避障的感觉反馈，以及 目标/地标识别。该项目的重点是完成人类受试者的测试， 这些能力。