Free viewpoint video synthesis and presentation from multiple sporting videos
Free viewpoint video synthesis and presentation from multiple sporting videos
复制标题
DOI：
10.1109/icme.2005.1521426
复制
发表时间：
2005-07
期刊：
影响因子：
--
通讯作者：
Naho Inamoto;H. Saito
中科院分区：
文献类型：
--
作者：
Naho Inamoto;H. Saito
本文介绍了两种体育赛事免费视点观测系统，该系统采用多摄像机在体育场内进行无标定拍摄。在第一个系统（视点点播系统）中，用户可以与原始体育场一起观看逼真的体育场景。在第二个系统（混合现实演示系统）中，用户可以通过视频透明头戴式显示器（HMD）虚拟地观看覆盖在桌面体育场模型上的场景。在这两个系统中，用户可以从他/她喜欢的视点观察体育赛事，其中虚拟视图图像是通过执行视图插值合成和呈现的。由于室外场景的照明经常会发生变化，我们开发了处理照明条件变化的系统。如果捕获的场景包含阴影，我们使用相机之间的投影几何来合成独立于真实相机图像的背景和前景阴影的虚拟视图图像。然后将前景物体的阴影分别叠加在用户面前的原始体育场或体育场模型的合成背景上。结果表明，阴影的出现可以产生逼真的混合现实呈现。
This paper introduces two kinds of free viewpoint observation systems for sporting events captured with uncalibrated multiple cameras in a stadium. In the first system (viewpoint on demand system), a user can watch the realistic sporting scenes with the original stadium. In the second system (mixed reality presentation system), a user can virtually watch the scenes overlaid on a desktop stadium model via a video see-through head mounted display (HMD). In the both systems, the user can observe sporting events from his/her favorite viewpoints, where the virtual view images are synthesized and presented by performing view interpolation. As outdoor scenes often have variations in lighting, we develop the systems to handle the changes of lighting condition. If the captured scene contains shadows, we synthesize the virtual view image of the shadows of the background and the foreground independently from real camera images using projective geometry between cameras. The shadows of the foreground objects are then overlaid on the synthesized background of the original stadium or the stadium model in front of the user respectively. The results indicate that the appearance of shadows can produce a realistic mixed reality presentation.