Direct Range Image Processing (DRIP)

边缘检测或更常见的特征提取可以很容易地在强度图像上执行，其中像素像棋盘上的正方形一样有规律地放置。最近，成像和计算机视觉的世界已经转向使用距离数据，使用距离相机或传感器获得。这个范围数据不是有规则间隔的，而是稍微随机间隔的，一些必需的信息可能会丢失。为了对这种不规则间隔的数据执行任何类型的图像处理，例如特征提取或分割，数据必须在数学上重新对齐到规则晶格上，并且在某些情况下重构缺失的数据。执行这些计算不仅需要时间，而且这些计算可能会引入近似误差和数据错误表示。为了避免这种不必要的计算和误差引入，本项目提出了一种基于有限元法（fem）的技术，该技术可以生成可以直接应用于距离图像的特征提取算子，而无需进行任何预处理，从而更适合于移动机器人应用的实时视觉。该项目将首先开发和实施用于不规则数据的操作器，并将其与其他现有技术进行比较。然后，该项目将解决找出在范围图像中找到的特征类型的问题。这是因为距离图像包含各种类型的边缘：屋顶，跳跃，折痕和平滑边缘。这些特征中的每一个都有不同的特征，为了确定图像中的特征类型，必须找到这些特征。这是这个项目的一个重要方面，因为大多数现有的研究只关注在距离图像中寻找折痕和跳跃边缘，而不是屋顶或光滑边缘。目前使用的许多物体识别系统都是基于分割算法的。机器人不能精确地确定场景的所有细节，而是将场景分割成可识别的区域或物体，并试图将它们与之前见过的物体相匹配。在完善基于有限元的特征提取技术和评估其准确表征距离图像特征的能力的基础上，将该技术用于距离数据的分割。该技术与简单的边缘连接算法相结合，可以提供封闭区域并减少分割过度或分割不足。为了使本研究适用于实时成像，从而对开发机器人视觉系统有用，要求程序用c++编程语言编码，程序员可以控制垃圾收集，并且程序运行所需的时间可以容易地测量。总的来说，该项目旨在提供特征提取算子，可以直接应用于距离数据进行距离图像处理，而不需要目前其他技术所必需的预处理步骤。这将减少所需的数学计算，从而提高实时视觉，这对开发机器人视觉系统很有用。

Edge detection or, more commonly, feature extraction can be readily performed on intensity images where the pixels are regularly placed like squares on a chessboard. More recently, the world of imaging and computer vision has moved towards the use of range data, obtained using a range camera or sensor. This range data is not regularly spaced, but instead is slightly randomly spaced and some of the required information may be missing. In order to perform any type of image processing, such as feature extraction or segmentation, on such irregularly spaced data, the data must be re-aligned mathematically on to a regular lattice, and in some cases the missing data is reconstructed. It not only takes time to perform these calculations, but such calculations can introduce approximation errors and data mis-representations. To avoid this unnecessary computation and error introduction, this project proposes a technique based on the use of finite element methods (FEMs) that will enable feature extraction operators to be generated that can be applied directly to the range image without any such pre-processing, thus proving to be more appropiate for real-time vision with the application of moving robots. This project will initially develop and implement the operators for use on irregular data and evaluate them in comparison to other existing techniques available. The project will then address the issue of finding out what type of feature has been found in the range image. The reason for this is that range image contain various types of edges: roof, jump, crease and smooth edge. Each of these features has different characteristics that must be found in order to determine the type of feature in the image. This is an important aspect of this project as most existing research focuses only on finding crease and jump edges in range images and not roof or smooth edges.Many object recognition systems used today are based on segmentation algorithms. Rather than a robot being able to determine precisely all the detail of a scene, it segments the scene into recognisable regions or objects and tries to match them with objects that it has seen before. On perfecting the finite element based feature extraction techniques and evaluating their ability to accurately characterise the features found in the range images, this technique will be used for segmentation of range data. The technique, combined with a simple edge-linking algorithm, should provide enclosed regions and reduce over or under segmentation.In order for this research to be appropriate for real-time imaging and hence useful for developing robot vision systems, it is required that the programs are coded in the C++ programming language, where the programmer has control of garbage collection and the time that it takes the program to run can be easily measured.Overall, this project aims to provide feature extraction operators that can be applied directly to range data for range image processing without the pre-processing steps that are currently essential to other techniques. This will reduce the mathematical computation required and thus enable improved real-time vision that can be useful for developing robot vision systems.