Toward a Computer Vision-based Wayfinding Aid for Blind Persons to Access Unfamiliar Indoor Environments.
Toward a Computer Vision-based Wayfinding Aid for Blind Persons to Access Unfamiliar Indoor Environments.
复制标题
DOI：
10.1007/s00138-012-0431-7
复制
发表时间：
2013-04-01
影响因子：
3.3
通讯作者：
Arditi, Aries
中科院分区：
文献类型：
--
作者：
Tian, YingLi;Yang, Xiaodong;Yi, Chucai;Arditi, Aries
关键词：
自助游对盲人和视障人士来说是众所周知的挑战。在本文中，我们提出了一种基于概念验证的计算机视觉定向辅助工具，用于帮助盲人独立进入陌生的室内环境。为了找到不同的房间(例如办公室、实验室或浴室)和其他建筑物设施(例如出口或电梯)，我们将对象检测与文本识别相结合。首先，我们开发了一种稳健而高效的算法，通过结合边缘和角点，基于门、电梯和橱柜的一般几何形状来检测它们。该算法具有较强的通用性，既能处理不同室内环境下外观不同的物体在类内变化较大的情况，又能处理门、门式橱柜等不同物体之间的微小类间差异。接下来，为了区分类内对象(例如，办公室门和卫生间门)，我们提取和识别与检测到的对象相关联的文本信息。对于文本识别，我们首先从具有多种颜色和可能复杂背景的标志中提取文本区域，然后应用字符定位和拓扑分析来滤除背景干扰。提取的文本使用现成的光学字符识别(OCR)软件产品进行识别。对象类型、方向、位置和文本信息以语音的形式呈现给盲人旅行者。
Independent travel is a well known challenge for blind and visually impaired persons. In this paper, we propose a proof-of-concept computer vision-based wayfinding aid for blind people to independently access unfamiliar indoor environments. In order to find different rooms (e.g. an office, a lab, or a bathroom) and other building amenities (e.g. an exit or an elevator), we incorporate object detection with text recognition. First we develop a robust and efficient algorithm to detect doors, elevators, and cabinets based on their general geometric shape, by combining edges and corners. The algorithm is general enough to handle large intra-class variations of objects with different appearances among different indoor environments, as well as small inter-class differences between different objects such as doors and door-like cabinets. Next, in order to distinguish intra-class objects (e.g. an office door from a bathroom door), we extract and recognize text information associated with the detected objects. For text recognition, we first extract text regions from signs with multiple colors and possibly complex backgrounds, and then apply character localization and topological analysis to filter out background interference. The extracted text is recognized using off-the-shelf optical character recognition (OCR) software products. The object type, orientation, location, and text information are presented to the blind traveler as speech.
登录
查看更多内容
DOI：
10.1109/tsmcc.2009.2021255
发表时间：
2010-01-01
期刊：
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS
影响因子：
--
作者：
Dakopoulos, Dimitrios;Bourbakis, Nikolaos G.
通讯作者：
Bourbakis, Nikolaos G.
影响因子：
5.4
作者：
BIEDERMAN, I
通讯作者：
BIEDERMAN, I
DOI：
10.1109/tpami.1986.4767851
发表时间：
1986-11-01
影响因子：
23.6
作者：
CANNY, J
通讯作者：
CANNY, J
DOI：
10.1207/s15327590ijhc1502_3
发表时间：
2003-01-01
影响因子：
4.7
作者：
Everingham, MR;Thomas, BT;Troscianko, T
通讯作者：
Troscianko, T
影响因子：
1.3
作者：
He, Xiao Chen;Yung, Nelson H. C.
通讯作者：
Yung, Nelson H. C.