Virtual Viewpoint Replay for a Soccer Match by View Interpolation From Multiple Cameras
Virtual Viewpoint Replay for a Soccer Match by View Interpolation From Multiple Cameras
复制标题
DOI：
10.1109/tmm.2007.902832
复制
发表时间：
2007-10
影响因子：
7.3
通讯作者：
Naho Inamoto;H. Saito
中科院分区：
文献类型：
--
作者：
Naho Inamoto;H. Saito
本文提出了一种新的方法，虚拟视图合成，使观众虚拟飞行通过真实的足球场景，这是由多个摄像机在一个体育场拍摄。所提出的方法生成的图像的任意视点附近的真实的相机图像的视图插值。在该方法中，相机不需要强烈的校准，因为相机之间的投影几何用于插值。为了避免三维恢复过程的复杂性和不可靠性，根据场景的几何特性将场景分割成若干区域。通过对每个区域应用射影几何，自动获得真实的视图之间的密集对应，这是中间视图生成所必需的。通过叠加所有区域的中间图像，生成整个足球场景的虚拟视图。减少了摄像机校准的工作量，并且对应匹配不需要手动操作，因此，所提出的方法可以很容易地应用于大空间中的动态事件。沿着介绍了一个应用于足球比赛回放的飞行观察的视图合成算法和实验结果。这是一种提供整个动态事件的任意视图的新方法。
This paper presents a novel method for virtual view synthesis that allows viewers to virtually fly through real soccer scenes, which are captured by multiple cameras in a stadium. The proposed method generates images of arbitrary viewpoints by view interpolation of real camera images near the chosen viewpoints. In this method, cameras do not need to be strongly calibrated since projective geometry between cameras is employed for the interpolation. For avoiding the complex and unreliable process of 3-D recovery, object scenes are segmented into several regions according to the geometric property of the scene. Dense correspondence between real views, which is necessary for intermediate view generation, is automatically obtained by applying projective geometry to each region. By superimposing intermediate images for all regions, virtual views for the entire soccer scene are generated. The efforts for camera calibration are reduced and correspondence matching requires no manual operation; hence, the proposed method can be easily applied to dynamic events in a large space. An application for fly-through observations of soccer match replays is introduced along with the algorithm of view synthesis and experimental results. This is a new approach for providing arbitrary views of an entire dynamic event.