A Cell Phone-Based Street Intersection Analyzer for Visually Impaired Pedestrians

描述（由申请人提供）：基于手机的视障行人路口分析仪摘要项目摘要城市路口是盲人出行中最危险的部分之一。它们变得越来越复杂，使得使用传统的盲定向和移动技术安全穿越变得更加困难。为了缓解这一问题，我们建议开发并评估一种基于手机的系统，以分析盲人或视障人士使用标准手机拍摄的十字路口图像，并提供实时反馈。在我们过去使用计算机视觉算法寻找人行横道和步行灯的原型“Crosswatch”系统的基础上，我们将极大地增强系统的功能，包括交叉口布局及其连接街道的身份信息，停车标志，单向线标志和其他指示路权的控制的存在，以及从步行/不步行灯，倒计时计时器和其他交通灯集成的计时信息。该系统将通过合成语音和音频相结合的方式，传达十字路口信息，并主动引导用户与人行横道对齐。我们会进行人为因素研究，以优化系统功能和用户界面的配置，并开发互动培训应用程序，让用户掌握更好地使用系统的技能。这些训练应用程序作为辅助交叉路口系统的附加手机软件来实施，将训练用户在穿过人行横道时保持相机水平和向前，并尽量减少转向。交叉分析和训练软件将免费提供给流行的手机（如iPhone， Android或Symbian机型）下载。手机将不需要任何硬件修改或附加组件来运行此软件。最终，用户将能够免费下载一整套这样的算法到他或她可能已经携带的手机上，而不必为每种功能携带单独的设备。

DESCRIPTION (provided by applicant): A Cell Phone-Based Street Intersection Analyzer for Visually Impaired Pedestrians Abstract Project Summary Urban intersections are among the most dangerous parts of a blind person's travel. They are becoming increasingly complex, making safe crossing using conventional blind orientation and mobility techniques ever more difficult. To alleviate this problem, we propose to develop and evaluate a cell phone-based system to analyze images of street intersections, taken by a blind or visually impaired person using a standard cell phone, to provide real-time feedback. Building on our past work on a prototype "Crosswatch" system that uses computer vision algorithms to find crosswalks and Walk lights, we will greatly enhance the functionality of the system with information about the intersection layout and the identity of its connecting streets, the presence of stop signs, one-way signs and other controls indicating right-of-way, and timing information integrated from Walk/Don't Walk lights, countdown timers and other traffic lights. The system will convey intersection information, and will actively guide the user to align himself/herself with crosswalks, using a combination of synthesized speech and audio tones. We will conduct human factors studies to optimize the system functionality and the configuration of the user interface, as well as develop interactive training applications to equip users with the skills to better use the system. These training applications, implemented as additional cell phone software to complement the intersection system, will train users to hold the camera horizontal and forward and to minimize veer when traversing a crosswalk. The intersection analysis and training software will be made freely available for download onto popular cell phones (such as iPhone, Android or Symbian models). The cell phone will not need any hardware modifications or add-ons to run this software. Ultimately a user will be able to download an entire suite of such algorithms for free onto the cell phone he or she is already likely to be carrying, without having to carry a separate piece of equipment for each function. PUBLIC HEALTH RELEVANCE: The ability to walk safely and confidently along sidewalks and traverse crosswalks is taken for granted every day by the sighted, but approximately 10 million Americans with significant vision impairments and a million who are legally blind face severe difficulties in this task. The proposed research would result in a highly accessible system (with zero or minimal cost to users) to augment existing wayfinding techniques, which could dramatically improve independent travel for blind and visually impaired persons.