AIR Option 1: Technology Translation: Automated Targeted Destination Recognition for the Blind with Motion Deblurring

该PFI：AIR技术翻译项目致力于翻译计算机视觉技术的研究进展，以填补盲人辅助技术研究与真实的需求之间的差距。该项目的目标是从基础研究中探索为盲人设计基于相机的可穿戴寻路助手的挑战的解决方案，以产生便携式概念验证原型，帮助盲人用户从复杂环境中识别目标目的地。该项目通过以下方式实现这一目标：1）开发鲁棒的运动去模糊方法来处理佩戴相机的盲人用户的不规则运动; 2）根据盲人用户的寻路和导航请求识别目标目的地。概念验证原型系统将通过太阳镜/帽子上的可穿戴摄像头和便携式计算机（迷你笔记本电脑或手机）捕获视觉信息进行数据分析，而语音/声音输出将通过蓝牙耳机提供给盲人用户。新开发的算法和概念验证原型的性能将由盲人受试者进行评估。该伙伴关系涉及不同领域的专业知识，包括大学研究，工业真实的系统设计和开发，盲人和视障人士组织的盲人用户研究，为最具挑战性的问题提供解决方案（运动模糊和基于查询的有针对性的目的地识别）在为盲人用户设计可穿戴的基于摄像头的寻路和导航辅助设备中的应用。专业知识的跨学科领域涉及到潜在的翻译基于计算机视觉的辅助技术沿着的道路，可能会导致竞争的商业现实。这将导致新的革命性的设计概念的成本效益和便携式相机为基础的辅助设备，以帮助视障人士实现功能的行动能力与正常视力的人。在未来10年内，潜在的经济影响预计将达到1.2亿美元，这将有助于提高美国在开发盲人寻路和导航技术方面的竞争力。 这项研究对视障人士有直接的影响，使他们更好地融入社会，增加他们未来的就业机会，在工作场所取得成功，独立生活，经济和社会自给自足。

This PFI: AIR Technology Translation project focuses on translating the research advances in computer vision technologies to fill the gap between research and the real needs in assistive technology for blind people. The goal of this project is to explore solutions for the challenges of designing wearable camera-based wayfinding assistants for blind persons from fundamental research to produce a portable proof-of-concept prototype to help blind users recognize targeted destinations from complex environments. The project accomplishes this goal by 1) developing robust motion deblurring methods to handle the irregular motions of blind users who are wearing the camera and 2) recognizing targeted destinations based on the requests of blind users for wayfinding and navigation. The proof-of-concept prototype system will be developed with visual information captured via a wearable camera on sunglasses/hat and a portable computer (mini laptop or cell phone) for data analysis, while the speech/sound outputs will be provided to a blind user via a Bluetooth earpiece. The performance of the newly developed algorithms and the proof-of-concept prototype will be evaluated by blind subjects.The partnership engages different areas of expertise including university research, industry real system design and development, and blind user study from organizations for the blind and visually handicapped to provide solutions for the most challenging problems (motion blur and query-based targeted destination recognition) in the design of wearable camera-based wayfinding and navigation aids for blind users. The interdisciplinary areas of expertise pertain to the potential to translate the computer vision based assistive technology along a path that may result in a competitive commercial reality. This will lead to new revolutionary design concepts of cost-effective and portable camera-based assistive devices to help visually impaired people in achieving functional mobility comparable to people with normal vision. The potential economic impact is expected to be $120 million in the next 10 years, which will contribute to the U.S. competitiveness in developing technology for blind wayfinding and navigation. This research has a direct impact to benefit the visually impaired, improve their inclusion and integration into society, and enhance their future employment opportunities, success in the workplace, independent living, and economic and social self-sufficiency.