Real Time 3D Robot Vision System based on Local Correlation Methods

点击翻译按钮获取中文摘要

We have succeeded to develop the real-time three dimensional robot vision systembased on local correlation image processing technique.The vision system provides the essential functions of robot vision ; real-time object tracking, motion detection and depth map generation.Although the local correlation method is heavy calculation, the vision system we have originally developed uses a special LSI (Motion Estimation Processor) chip which is designed for image compression.The system consists of multiple visual unit board which has a general processor and the special LSI.As the image is broadcasted into the multiple visual units, the system can perform to process the image in parallel. In each unit, it is possible to calculation motion detection and motion tracking based on the block matching method of local windows.The application of the vision system includes, three dimensional object tracking, even if the object turned, optical flow generation, stereo matching, and depthmap generation.The system is extended to accept color images by developing color decording board. The color information put the vision system robustness for veryfying the trackability of the local windows.We have applied the vision system to several robotic application, including autonomous mobile car navigation, real time visual servoing, vision based motion guidance of mobile robot, manipulators and legged robots.