Scalable Free-Viewpoint 3D Video Streaming

可扩展的自由视点 3D 视频流

• 批准号: 466252-2014
• 负责人: Shirmohammadi, Shervin
• 金额: $ 2.59万
• 依托单位: University of Ottawa
• 依托单位国家: 加拿大
• 项目类别: Collaborative Research and Development Grants
• 财政年份: 2015
• 资助国家: 加拿大
• 起止时间: 2015-01-01 至 2016-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=577146
• 关键词: Scalable; Free; Viewpoint; 3D; Video

Traditional video systems present only a single view of the 3D world to viewers. For a more realistic experience; however, one should to be able to view a scene from different viewpoints, as in the real world. While 3D video enables viewers to perceive depth, 3D alone is also limited to a specific viewing angle and does not show different viewpoints. In contrast, free-viewpoint video enables viewers to navigate freely to any viewpoint and allows them to see interesting aspects in the video and enjoy a rich and immersive experience. However, free-viewpoint videos face multiple research challenges that have so far prevented their wide adoption. First, a user may request a viewpoint that was not captured by the cameras. This requires synthesizing, in real-time, the requested view from existing views, which is a computationally expensive process. Second, the streaming server needs to be scalable in order to support many viewers interacting with it. Third, viewers typically use different displays, from smartphones and tablets to large displays, and also use different network access such as 4G, 3G, ADSL, WiMax, WiFi, etc. Therefore, a free-viewpoint system must support clients with heterogeneous requirements. To address the above challenges, in this project we propose to work with Cisco Systems Canada, specifically their Video and Content Platforms Research and Advanced Development group in Toronto, Ontario, Canada, to study, design, and develop a free-viewpoint streaming system. Cisco builds and sells industry-leading video streaming systems, such as their Videoscape platform, which powers subscriber experiences that are personalized, synchronized, and more social than existing products.

传统的视频系统仅向观看者呈现3D世界的单个视图。为了更现实的 经验;然而，一个人应该能够从不同的观点来看待一个场景，就像在真实的世界中一样。 虽然3D视频使观看者能够感知深度，但单独的3D也限于特定的视角， 并没有表现出不同的观点。相比之下，自由视点视频使观众能够自由地导航到任何 观看者可以从视频中看到有趣的方面，并享受丰富而身临其境的体验。 然而，自由视点视频面临着多种研究挑战，迄今为止，这些挑战阻碍了其广泛的应用。 领养首先，用户可以请求未被相机捕获的视点。这需要 从现有视图中实时合成所请求的视图，这是计算上昂贵的 过程其次，流媒体服务器需要可扩展，以支持许多观众与它交互。 第三，观众通常使用不同的显示器，从智能手机和平板电脑到大型显示器，并且还使用 不同的网络接入，如4G，3G，ADSL，WiMax，WiFi等，因此，自由视点系统必须 支持具有不同需求的客户。为了应对上述挑战，在本项目中，我们建议 与思科系统加拿大公司合作，特别是他们的视频和内容平台研究和高级 开发组在多伦多，安大略，加拿大，研究，设计和开发一个自由的观点流 系统思科构建和销售行业领先的视频流系统，如他们的Videoscape平台， 为用户提供个性化、同步化和社交化的体验， 产品.