Development of multi-eyes camera by using smart image sensors and its application to high speed image processing system

点击翻译按钮获取中文摘要

In this research, we have investigated a new computational image sensor which has image processing circuits on a same chip and its application to high speed image processing system.1 We have investigated the algorithm for on-chip or off-chip image processing. The sensor detects the difference between two frames and outputs the position information of the detected pixels.2 We have designed a prototype LSI of CMOS image sensor which has 128x128 pixels. It can operate at 5000 frame / second. The sensor was designed by column parallel architecture and the image processing can be done by the analog processing circuits. We have fabricated the LSI chip by the fabrication service CMP.3 We have fabricated the binocular stereo camera system by using the smart sensor chip.4 We have designed the high speed image processing system by using the camera system and FPGA chip which can process the pixel value and position information of the moving pixels in real time. It can operate at more than 1200 frame / second.5 We have verified that the several moving objects can be tracked by using the processing system in parallel. Furthermore, the system can estimate the depth between the objects and the camera in real time. We can get 15cm accuracy of depth estimation at high frame rate.