Panoramic video stitching and view synthesis for high definition videoconferencing

高清晰度视频会议(HDVC)可以被认为是视频会议，其中视频质量是高清晰度；即1920x1080像素的帧大小，每秒逐行扫描30帧，通常被称为1080p30。从用户的角度来看，HDVC将显著提高视频会议的在线、感知、逼真和细节方面的质量，提供丰富的用户体验。本质上，HDVC为视觉交流增加了身临其境的能力，通过详细的面部表情、肢体语言、视觉清晰度和保真度等显著提高了用户体验。尽管HDVC领域存在许多研究挑战，但我们的行业合作伙伴、总部位于渥太华的Magor Communications Corporation(以下称为Magor)已确定两个具体的挑战具有高度优先事项。首先，在许多情况下，HDVC覆盖了需要用多个摄像头拍摄的场地；因此，如何将来自这些多个摄像头的视频实时和高清质量拼接在一起，是创建如此高度身临其境的体验的一个挑战。其次，在给定来自两个摄像机(在立体摄像机设置中)的两个图像的情况下，观众通常需要看到中间的“虚拟”视图，这表明需要进行视图合成，这涉及构建新的中间图像，就好像是从虚拟摄像机中获取的一样，同样是实时的和高清质量的。

High Definition Video Conferencing (HDVC) can be thought of as video conferencing where the video quality is High Definition; i.e., 1920x1080 pixels frame size at 30 frames per second progressive scan, commonly referred to as 1080P30. From a user's perspective, HDVC will significantly improve the quality of video conferencing in terms of presence, awareness, realism, and details, providing a rich user experience. Essentially, HDVC adds an immersive capability to visual communication which dramatically increases the user experience through detailed facial expression, body language, visual clarity and fidelity, etc. While many research challenges exist in the field of HDVC, two specific ones have been identified to have high priority by our industry partner, Ottawa-based Magor Communications Corporation (henceforth called Magor),. First, in many cases, HDVC covers venues that need to be captured with multiple cameras; hence, how to stitch the video from those multiple cameras together, in real-time and in HD quality, is a challenge for creating such a highly immersive experience. Second, given two images from two cameras (in a stereo camera setup), there is usually a need for a viewer to see an intermediate "virtual" view, signaling a need for view synthesis which involves the construction of a new in-between image as if taken from a virtual camera, again in real-time and in HD quality.