Panoramic video stitching and view synthesis for high definition videoconferencing

高清视频会议的全景视频拼接和视图合成

• 批准号: 434502-2012
• 负责人: Shirmohammadi, Shervin
• 金额: $ 4.37万
• 依托单位: University of Ottawa
• 依托单位国家: 加拿大
• 项目类别: Collaborative Research and Development Grants
• 财政年份: 2012
• 资助国家: 加拿大
• 起止时间: 2012-01-01 至 2013-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=498678
• 关键词: Panoramic; video; stitching; view; synthesis

High Definition Video Conferencing (HDVC) can be thought of as video conferencing where the video quality is High Definition; i.e., 1920x1080 pixels frame size at 30 frames per second progressive scan, commonly referred to as 1080P30. From a user's perspective, HDVC will significantly improve the quality of video conferencing in terms of presence, awareness, realism, and details, providing a rich user experience. Essentially, HDVC adds an immersive capability to visual communication which dramatically increases the user experience through detailed facial expression, body language, visual clarity and fidelity, etc. While many research challenges exist in the field of HDVC, two specific ones have been identified to have high priority by our industry partner, Ottawa-based Magor Communications Corporation (henceforth called Magor),. First, in many cases, HDVC covers venues that need to be captured with multiple cameras; hence, how to stitch the video from those multiple cameras together, in real-time and in HD quality, is a challenge for creating such a highly immersive experience. Second, given two images from two cameras (in a stereo camera setup), there is usually a need for a viewer to see an intermediate "virtual" view, signaling a need for view synthesis which involves the construction of a new in-between image as if taken from a virtual camera, again in real-time and in HD quality.

高清视频会议（HDVC）可以被认为是视频会议，其中视频质量是高清晰度的；即1920x1080像素的帧大小，每秒30帧的逐行扫描，通常称为1080P30。从用户的角度来看，HDVC将在临场感、意识、真实感和细节方面显著提高视频会议的质量，提供丰富的用户体验。从本质上讲，HDVC为视觉交流增加了沉浸式能力，通过详细的面部表情、肢体语言、视觉清晰度和保真度等显著提高了用户体验。尽管HDVC领域存在许多研究挑战，但我们的行业合作伙伴，总部位于渥太华的Magor通信公司（以下简称Magor）已经确定了两个具有高度优先级的特定挑战。首先，在许多情况下，HDVC覆盖了需要用多台摄像机拍摄的场地；因此，如何将来自多个摄像头的视频拼接在一起，以实时和高清的质量，是创造这种高度身临其境的体验的挑战。其次，给定来自两个摄像机的两幅图像（在立体摄像机设置中），通常需要观看者看到中间的“虚拟”视图，这表明需要视图合成，这涉及到构建一个新的中间图像，就像从虚拟摄像机中拍摄的一样，再次实时和高清质量。