Online video synthesis for removing occluding objects using multiple uncalibrated cameras via plane sweep algorithm
Online video synthesis for removing occluding objects using multiple uncalibrated cameras via plane sweep algorithm
复制标题
通过平面扫描算法使用多个未校准相机去除遮挡物体的在线视频合成
DOI：
10.1109/icdsc.2009.5289380
复制
发表时间：
2009
期刊：
影响因子：
--
通讯作者：
H. Saito
中科院分区：
文献类型：
--
作者：
Takahide Hosokawa;Songkran Jarusirisawad;H. Saito
我们提出了一个在线渲染系统，该系统使用多个摄像机拍摄的多个视频从输入视频中去除客观场景前面的遮挡对象。为了获得所有摄像机之间的几何关系，我们使用投影网格空间（PGS）定义的极几何之间的两个基本摄像机。然后，我们应用平面扫描算法在输入相机中生成深度图像。通过从扫描平面的体积中排除遮挡物体的区域，我们可以生成没有遮挡物体的深度图。使用这个深度图，我们可以从所有多个摄像机视频中无障碍地渲染图像。由于我们使用图形处理器（GPU）进行计算，我们可以实现实时在线渲染使用普通规格的PC和多个USB摄像头。
We present an online rendering system which removes occluding objects in front of the objective scene from an input video using multiple videos taken with multiple cameras. To obtain geometrical relations between all cameras, we use projective grid space (PGS) defined by epipolar geometry between two basis cameras. Then we apply plane-sweep algorithm for generating depth image in the input camera. By excluding the area of occluding objects from the volume of the sweeping planes, we can generate the depthmap without the occluding objects. Using this depthmap, we can render the image without obstacles from all the multiple camera videos. Since we use graphics processing unit (GPU) for computation, we can achieve realtime online rendering using a normal spec PC and multiple USB cameras.