Real-Time Image Mosaicing System Using a High-Frame-Rate Video Sequence
Real-Time Image Mosaicing System Using a High-Frame-Rate Video Sequence
复制标题
DOI：
10.20965/jrm.2015.p0012
复制
发表时间：
2015-02-01
影响因子：
1.1
通讯作者：
Ishii, Idaku
中科院分区：
文献类型：
--
作者：
Gu, Qingyi;Raut, Sushil;Ishii, Idaku
在本文中，我们提出了一种使用高帧率视频序列的实时图像拼接系统。我们提出的系统可以根据估计的帧间位移和方向变化拼接图像，将以 500 fps 捕获的 512 x 512 彩色图像实时拼接为单个合成全景图像。在该系统中，通过实现Harris角点检测的并行处理电路模块来加速特征点提取，并且假设高速视觉中帧与帧之间的图像位移变得更小，当前帧中的数百个选定的特征点可以同时与前一帧中的相邻范围内的特征点相对应。我们的系统在 500 fps 下改进基于特征的实时图像拼接的功效通过在基于现场可编程门阵列 (FPGA) 的高速视觉平台上实现并进行多项实验得到了验证：(1) 使用安装在快速移动的二自由度主动视觉上的相机捕获室内场景，(2) 使用手动以周期性方式快速移动的手持相机捕获室外场景。
In this paper, we propose a real-time image mosaicing system that uses a high-frame-rate video sequence. Our proposed system can mosaic 512 x 512 color images captured at 500 fps as a single synthesized panoramic image in real time by stitching the images based on their estimated frame-to-frame changes in displacement and orientation. In the system, feature point extraction is accelerated by implementing a parallel processing circuit module for Harris corner detection, and hundreds of selected feature points in the current frame can be simultaneously corresponded with those in their neighbor ranges in the previous frame, assuming that frame-to-frame image displacement becomes smaller in high-speed vision. The efficacy of our system for improved feature-based real-time image mosaicing at 500 fps was verified by implementing it on a field-programmable gate array (FPGA)-based high-speed vision platform and conducting several experiments: (1) capturing an indoor scene using a camera mounted on a fast-moving two-degrees-of-freedom active vision, (2) capturing an outdoor scene using a hand-held camera that was rapidly moved in a periodic fashion by hand.