Panoramic video stitching and view synthesis for high definition videoconferencing

高清视频会议（HDVC）可以被认为是视频质量是高清的视频会议;即，1920 x1080像素帧大小，每秒30帧逐行扫描，通常称为1080 P30。从用户的角度来看，HDVC将显著提高视频会议在临场感、感知、真实感和细节方面的质量，提供丰富的用户体验。从本质上讲，HDVC为视觉通信增加了沉浸式功能，通过详细的面部表情，肢体语言，视觉清晰度和保真度等大大提高了用户体验。虽然HDVC领域存在许多研究挑战，但我们的行业合作伙伴，渥太华的Magor Communications Corporation（以下称为Magor）已经确定了两个特定的挑战。首先，在许多情况下，HDVC覆盖了需要用多个摄像头捕捉的场地;因此，如何将来自这些多个摄像头的视频实时和高清质量拼接在一起，对于创建这种高度沉浸式体验来说是一个挑战。第二，给定来自两个相机的两个图像（在立体相机设置中），通常需要观看者看到中间“虚拟”视图，这表明需要视图合成，其涉及构建新的中间图像，就像从虚拟相机拍摄的一样，再次实时和HD质量。

High Definition Video Conferencing (HDVC) can be thought of as video conferencing where the video quality is High Definition; i.e., 1920x1080 pixels frame size at 30 frames per second progressive scan, commonly referred to as 1080P30. From a user's perspective, HDVC will significantly improve the quality of video conferencing in terms of presence, awareness, realism, and details, providing a rich user experience. Essentially, HDVC adds an immersive capability to visual communication which dramatically increases the user experience through detailed facial expression, body language, visual clarity and fidelity, etc. While many research challenges exist in the field of HDVC, two specific ones have been identified to have high priority by our industry partner, Ottawa-based Magor Communications Corporation (henceforth called Magor),. First, in many cases, HDVC covers venues that need to be captured with multiple cameras; hence, how to stitch the video from those multiple cameras together, in real-time and in HD quality, is a challenge for creating such a highly immersive experience. Second, given two images from two cameras (in a stereo camera setup), there is usually a need for a viewer to see an intermediate "virtual" view, signaling a need for view synthesis which involves the construction of a new in-between image as if taken from a virtual camera, again in real-time and in HD quality.