Efficient Video Stitching Based on Fast Structure Deformation
Efficient Video Stitching Based on Fast Structure Deformation
复制标题
DOI：
10.1109/tcyb.2014.2381774
复制
发表时间：
2015-12-01
影响因子：
11.8
通讯作者：
Li, Xuelong
中科院分区：
文献类型：
--
作者：
Li, Jing;Xu, Wei;Li, Xuelong
在计算机视觉中，视频拼接是一个非常具有挑战性的问题。在本文中，我们提出了一种高效和有效的基于快速结构变形的宽视角视频拼接方法，能够同时实现拼接质量和计算效率。对于一组同步帧，首先，设计一种有效的双缝选择方案，在两幅原始图像中搜索两个不同但结构上对应的缝。进一步考虑前一帧的接缝位置以保持帧间一致性。然后，沿着双缝，进行一维特征检测和匹配，以捕获相邻两个视图之间的结构关系。第三，在特征匹配之后，我们提出了一种有效的算法来线性传播变形向量，以消除结构错位。最后，采用基于超松弛迭代（SORI）求解器的快速梯度融合算法对图像灰度失调进行校正。SORI初始化的原则性解决方案大大减少了所需的迭代次数。我们已经比较有利我们的方法与七个国家的最先进的图像和视频拼接算法，以及传统的。实验结果表明，我们的方法优于现有的整体拼接质量和计算效率相比。
In computer vision, video stitching is a very challenging problem. In this paper, we proposed an efficient and effective wide-view video stitching method based on fast structure deformation that is capable of simultaneously achieving quality stitching and computational efficiency. For a group of synchronized frames, firstly, an effective double-seam selection scheme is designed to search two distinct but structurally corresponding seams in the two original images. The seam location of the previous frame is further considered to preserve the inter-frame consistency. Secondly, along the double seams, 1-D feature detection and matching is performed to capture the structural relationship between the two adjacent views. Thirdly, after feature matching, we propose an efficient algorithm to linearly propagate the deformation vectors to eliminate structure misalignment. At last, image intensity misalignment is corrected by rapid gradient fusion based on the successive over relaxation iteration (SORI) solver. A principled solution to the initialization of the SORI significantly reduced the number of iterations required. We have compared favorably our method with seven state-of-the-art image and video stitching algorithms as well as traditional ones. Experimental results show that our method outperforms the existing ones compared in terms of overall stitching quality and computational efficiency.