Development of multi-eyes camera by using smart image sensors and its application to high speed image processing system

智能图像传感器多眼相机的研制及其在高速图像处理系统中的应用

• 批准号: 12838010
• 负责人: HAMAMOTO Takayuki
• 金额: $ 2.05万
• 依托单位: Tokyo University of Science
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (C)
• 财政年份: 2000
• 资助国家: 日本
• 起止时间: 2000 至 2001
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-12838010/
• 关键词: Computational sensor; Smart image sensor; Vision chip; Image processing system; Real time processing; FPGA; FPGA; インテリジェントセンサ; ステレオ

In this research, we have investigated a new computational image sensor which has image processing circuits on a same chip and its application to high speed image processing system.1 We have investigated the algorithm for on-chip or off-chip image processing. The sensor detects the difference between two frames and outputs the position information of the detected pixels.2 We have designed a prototype LSI of CMOS image sensor which has 128x128 pixels. It can operate at 5000 frame / second. The sensor was designed by column parallel architecture and the image processing can be done by the analog processing circuits. We have fabricated the LSI chip by the fabrication service CMP.3 We have fabricated the binocular stereo camera system by using the smart sensor chip.4 We have designed the high speed image processing system by using the camera system and FPGA chip which can process the pixel value and position information of the moving pixels in real time. It can operate at more than 1200 frame / second.5 We have verified that the several moving objects can be tracked by using the processing system in parallel. Furthermore, the system can estimate the depth between the objects and the camera in real time. We can get 15cm accuracy of depth estimation at high frame rate.

在这项研究中，我们研究了一种将图像处理电路集成在一块芯片上的新型计算图像传感器及其在高速图像处理系统中的应用。1.研究了片上和片外图像处理算法。传感器检测两帧之间的差异，并输出检测像素的位置信息。2.设计了一个128×128像素的CMOS型图像传感器的LSI原型。它可以以5000帧/秒的速度运行。传感器采用列并行结构设计，图像处理由模拟处理电路完成。3、利用智能传感器芯片制作了双目立体摄像系统。4、利用摄像系统和现场可编程门阵列芯片设计了高速图像处理系统，能够实时处理运动像素的像素值和位置信息。该处理系统可以在1200帧/秒以上的速度下运行。5我们验证了该处理系统能够并行跟踪多个运动目标。此外，该系统还可以实时估计物体与摄像机之间的深度。在高帧频条件下，深度估计精度可达15 cm。

项目成果

喜多 ちえ: "ステレオ動画像圧縮センサを用いた動物体追跡システム"Image Media Processing Symposium. 21-22 (2000)

Chie Kita：“使用立体视频压缩传感器的动物跟踪系统”图像媒体处理研讨会21-22（2000）。

C.KITA. S.NAGAO. T.HAMAMOTO. M.AKAIKE and K.AIZAWA.: "Object tracking system with stereo image compression sensors"Image Media Processing Symposium. 21-22 (2000)

C.北田。

C.YOSHIKAWA. T.HAMAMOTO and K.AIZAWA: "Object tracking by using A/D conversion image sensor and FPGA"Image Media Processing Symposium. 103-104 (2001)

C.吉川。

C.KITA. S.NAGAO, T.HAMAMOTO, M.AKAIKE and K.AIZAWA: "Objeet tracking by using smart image sensor and FPGA"IEICE general conference. D-11-128. (2001)

C.北田。

吉川千里: "A/D変換イメージセンサとFPGAを用いた動物体追跡"Image Media Processing Symposium. 103-104 (2001)

Chisato Yoshikawa：“使用 A/D 转换图像传感器和 FPGA 进行移动物体跟踪”图像媒体处理研讨会 103-104 (2001)。