MobileEye OCR for the Visually Impaired

描述（由申请人提供）：在本SBIR中，我们建议证明移动的OCR的技术可行性，这是一种便携式软件系统，利用现有的个人设备为老年人或视障人士提供文本材料。该系统将帮助这些低视力者进行基本的日常活动，如购物、做饭、服药和阅读交通标志。它将超越我们提出的MobileEyes视觉增强系统，将尖端识别技术应用于移动的设备。该系统将使用普通的照相手机硬件来捕获和增强文本信息，执行光学字符识别（OCR）并提供音频或视觉反馈。我们的研究将集中在有限资源的移动的设备上实现和集成新的视觉增强和分析技术。具体来说，我们将开发算法，用于检测和纠正的平面和广义圆柱体上的文本受到透视失真，实现更强大和有效的算法和系统的稳定和增强的文本块，提供移动的OCR在复杂的纹理背景，并实现这些技术在小型设备上跨越各种平台。识别的文本将通过文本到语音（TTS）呈现，或以增强的质量显示在设备上，以便低视力用户轻松阅读。第一阶段将侧重于展示我们的方法的技术可行性，并将纳入一个性能测量方法，以定量评估进展和评估我们的系统与其他方法。与现有的视觉增强设备（例如放大镜、望远镜）和文本阅读设备（例如基于扫描仪的OCR）相比，我们的解决方案具有以下几个优点：1）它利用单个便携式设备（照相蜂窝电话），其通常可用并且通常已经携带用于其电信能力; 2）用户可以有选择地使用它，这样他们就不会被不相关的信息淹没; 3）它可以直接与其他应用程序集成，用于专门的任务。我们的研究成果将影响数百万低视力个体和盲人，以及视觉和计算机视觉研究人员。我们的团队是唯一有资格探索将视觉应用扩展到这些设备的可行性，并为集成未来的视觉算法提供平台。

DESCRIPTION (provided by applicant): In this SBIR we propose to demonstrate the technical feasibility of Mobile OCR, a portable software system which makes use of existing personal devices to provide access to textual materials for the elderly or the visually impaired. The system will help these low vision individuals with basic daily activities, such as shopping, preparing meals, taking medication, and reading traffic signs. It will step beyond our proposed MobileEyes vision enhancement system to apply cutting edge recognition technology for mobile devices. The system will use common camera phone hardware to capture and enhance textual information, perform Optical Character Recognition (OCR) and provide audio or visual feedback. Our research will focus on implementing and integrating new vision enhancement and analysis techniques on limited resource mobile devices. Specifically, we will develop algorithms for detection and rectification of text on planes and generalized cylinders subject to perspective distortions, implement more robust and efficient algorithms and systems for stabilization and enhancement of text blocks, provide mobile OCR on complex textured backgrounds, and implement these techniques on small devices across a variety of platforms. The recognized text will be presented through Text-to-Speech (TTS), or displayed on the device with enhanced quality which can be easily read by low vision users. Phase I will focus on demonstrating the technical feasibility of our approach, and will incorporate a performance measurement methodology to quantitatively evaluate progress and evaluate our system against other approaches. In comparison to existing vision enhancement devices, such as magnifying glasses, telescopes, and text reading devices such as scanner-based OCR, our solution has several advantages: 1) it makes use of a single, portable device (camera cell phone) that is commonly available and typically already carried for its telecommunications capabilities; 2) it can be used selectively by users so they will not be overwhelmed by irrelevant information; and 3) it can be integrated directly with other applications for specialized tasks. Our research results will impact the millions of low-vision individuals and the blind, as well as vision and computer vision researchers. Our team is uniquely qualified to explore the feasibility of extending visual applications to these devices, and provide a platform for integrating future vision algorithms.