FUNCTIONAL ASSESSMENT OF A CAMERA PHONE-BASED WAYFINDING SYSTEM OPERATED BY BLIND AND VISUALLY IMPAIRED USERS

FUNCTIONAL ASSESSMENT OF A CAMERA PHONE-BASED WAYFINDING SYSTEM OPERATED BY BLIND AND VISUALLY IMPAIRED USERS
复制标题

DOI:
10.1142/s0218213009000196
复制
发表时间:
2009-06-01
影响因子:
1.1
通讯作者:
Manduchi, Roberto
Manduchi, Roberto
中科院分区:
计算机科学4区
文献类型:
--
作者:
Coughlan, James;Manduchi, Roberto

文献摘要

被引文献

相似文献

我们描述了一种用于盲人和视障人士的寻路系统,该系统使用照相手机来确定用户相对于张贴在感兴趣位置(例如办公室)的颜色标记的位置,这些颜色标记由电话自动检测。彩色标记标志是专门设计的,可以在混乱的环境中使用手机上运行的计算机视觉软件进行实时检测;一种新颖的分割算法可以快速定位每张图像中彩色标记的边界,这使得系统可以计算标记距离手机的距离。我们提出了一个模型,说明用户的扫描策略(即他/她如何左右摇摄手机以找到颜色标记)如何影响系统检测颜色标记的能力,因为运动模糊施加了限制,而运动模糊在相机运动时总是可能发生的。最后,我们描述了我们的系统在盲人和视障志愿者中进行的测试,展示了他们在各种室内和室外环境中可靠地使用该系统查找由颜色标记指定的位置的能力,并阐明了哪些搜索策略对用户最有效。
We describe a wayfinding system for blind and visually impaired persons that uses a camera phone to determine the user's location with respect to color markers, posted at locations of interest (such as offices), which are automatically detected by the phone. The color marker signs are specially designed to be detected in real time in cluttered environments using computer vision software running on the phone; a novel segmentation algorithm quickly locates the borders of the color marker in each image, which allows the system to calculate how far the marker is from the phone. We present a model of how the user's scanning strategy (i.e. how he/she pans the phone left and right to find color markers) affects the system's ability to detect color markers given the limitations imposed by motion blur, which is always a possibility whenever a camera is in motion. Finally, we describe experiments with our system tested by blind and visually impaired volunteers, demonstrating their ability to reliably use the system to find locations designated by color markers in a variety of indoor and outdoor environments, and elucidating which search strategies were most effective for users.