Real-Time Detection and Reading of LED/LCD Displays for Visually Impaired Persons.
Real-Time Detection and Reading of LED/LCD Displays for Visually Impaired Persons.
复制标题
DOI：
10.1109/wacv.2011.5711544
复制
发表时间：
2011-01-05
期刊：
影响因子：
--
通讯作者：
Shen H
中科院分区：
文献类型：
--
作者：
Tekin E;Coughlan JM;Shen H
现代家用电器，如微波炉和DVD播放机，越来越需要用户阅读LED或LCD显示器来操作它们，这对失明或视力障碍的人构成了严重的障碍。虽然支持OCR的设备正在出现，以解决阅读打印文档中的文本的相关问题，但它们的设计并不是为了解决在家用电器显示器中查找和阅读字符的挑战。任何读取这些字符的系统都必须解决首先在大量背景杂乱中定位字符的挑战；此外，低对比度和显示表面上丰富的镜面高光-在相机移动时以不可预测的方式降低图像-激发了对以每秒几帧的速度处理图像的系统的需求，而不是强迫用户拍摄几张照片，每一张照片可能需要几秒钟的时间来获取和处理，直到一张照片可读。我们描述了一种新颖的系统，它可以采集视频，实时检测和读取LED/LCD字符，并通过合成语音朗读给用户。该系统已在台式电脑和手机上实现。实验结果在视频显示图像上进行了报告，验证了系统的可行性。
Modern household appliances, such as microwave ovens and DVD players, increasingly require users to read an LED or LCD display to operate them, posing a severe obstacle for persons with blindness or visual impairment. While OCR-enabled devices are emerging to address the related problem of reading text in printed documents, they are not designed to tackle the challenge of finding and reading characters in appliance displays. Any system for reading these characters must address the challenge of first locating the characters among substantial amounts of background clutter; moreover, poor contrast and the abundance of specular highlights on the display surface – which degrade the image in an unpredictable way as the camera is moved – motivate the need for a system that processes images at a few frames per second, rather than forcing the user to take several photos, each of which can take seconds to acquire and process, until one is readable. We describe a novel system that acquires video, detects and reads LED/LCD characters in real time, reading them aloud to the user with synthesized speech. The system has been implemented on both a desktop and a cell phone. Experimental results are reported on videos of display images, demonstrating the feasibility of the system.