RI: Small: Towards Portable Navigational Devices for the Visually Impaired

本项目的目标是设计计算机视觉方法，使便携式盲人导航设备（PBND），以指导视障人士在非结构化的环境。该项目的主要研究问题是回答采用单个感知传感器的方法是否可以解决盲导航问题，包括PBND的定位和物体识别。这项工作的一个显着特点是，它解决了盲导航问题，同时处理的视觉和距离信息的三维成像传感器。该项目包括四个相关的研究工作。首先，它研究了在GPS拒绝环境中准确和精确的PBND姿态估计技术。 其次，它开发了一种有效的三维数据分割方法，使场景识别的寻路。第三，将位姿估计方法应用于三维距离数据的配准，并设计了减小配准误差的方法。第四，它解决了在有限的计算能力的PBND中的方法的实时实现。 这项研究将产生新的算法，可以在短期内改善视力受损者的生活。它们还将实现小型机器人的自主性，这些机器人在军事态势感知、消防和搜索救援方面有更广泛的应用。这些发现将彻底改变小型机器人的自主性，并影响整个机器人研究界。更广泛的影响还包括对本科生和研究生的培训，以及通过研讨会和科学博物馆和技术展示馆的机器人展览来教育公众了解机器人技术。

The objective of this project is to devise computer vision methods that enable a Portable Blind Navigational Device (PBND) to guide a visually impaired person in unstructured environments. The main research question of this project is to answer if the approach of employing a single perception sensor can solve blind navigation problem, including localization of the PBND and object recognition. A distinctive feature of this work is that it addresses blind navigation problem by simultaneously processing the visual and range information of a 3D imaging sensor. The project consists of four related research endeavors. First, it investigates techniques for accurate and precise pose estimation of the PBND in a GPS-denied environment. Second, it develops an effective 3D data segmentation method to allow scene recognition for wayfinding. Third, it applies the pose estimation method to register 3D range data and devises methods to reduce registration error. Four, it addresses real-time implementation of the methods in the PBND with limited computing power. The research will result in new algorithms that can improve the lives of the visually impaired in the near term. They will also enable the autonomy of small robots that have wider applications in military situational awareness, firefighting, and search and rescue. The discoveries will revolutionize small robot autonomy and impact the robotics research community as a whole. Broader impacts also include training of undergraduate and graduate students, and educating the public on robotics through workshops and robot exhibits in science museums and technology showcases.