Generating virtual reality content from regular 2D videos

从常规 2D 视频生成虚拟现实内容

• 批准号: 514441-2017
• 负责人: Hefeeda, Mohamed
• 金额: $ 1.82万
• 依托单位: Simon Fraser University
• 依托单位国家: 加拿大
• 项目类别: Engage Grants Program
• 财政年份: 2017
• 资助国家: 加拿大
• 起止时间: 2017-01-01 至 2018-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=640443
• 关键词: Generating; virtual; reality; content; regular

ScopeMedia provides advanced video/image analysis and search products where similar video/image samplesare retrieved based on input collected from the user. ScopeMedia has several products in this domain withvarious applications. An important market segment for ScopeMedia and its products is the fashion industry,where visual information is crucial. ScopeMedia is considering providing an immersive experience of fashionevents, where a user can navigate a scene from different angles. This will allow users to feel present in variousevents such as fashion shows and explore the scene in a more immersive way. Popular events such as fashionshows are typically captured from multiple video cameras, and the goal is to generate Virtual Reality (VR)content from regular 2D video feeds, without installing expensive and specialize camera rigs. Generating VRcontent from regular 2D videos is, however, challenging. In this project, we will build on our prior experienceof converting 2D videos to 3D and we will explore the possibility of utilizing multiple regular cameras togenerate VR content by merging their content together without the use of 360 camera rigs. A prototype systemwill be designed and implemented, which will be focused on fashion events. ScopeMedia will provide us withvideo footage of multiple events. They will also provide us with information on typical setups in such eventsand the usual viewers' needs and interests.

ScopeMedia提供先进的视频/图像分析和搜索产品，根据从用户收集的输入检索类似的视频/图像样本。ScopeMedia在这个领域有几个产品，具有各种应用。ScopeMedia及其产品的一个重要细分市场是时尚行业，其中视觉信息至关重要。ScopeMedia正在考虑提供一种沉浸式的时尚活动体验，用户可以从不同的角度浏览场景。这将使用户能够在时装秀等各种活动中感受到存在感，并以更身临其境的方式探索场景。流行的活动，如时装秀，通常是从多个摄像机捕捉，目标是从常规的2D视频源生成虚拟现实（VR）内容，而无需安装昂贵的专用摄像机。然而，从常规的2D视频生成VR内容具有挑战性。在这个项目中，我们将建立在我们之前将2D视频转换为3D的经验基础上，我们将探索利用多个常规摄像机通过将它们的内容合并在一起而不使用360摄像机设备来生成VR内容的可能性。将设计和实现一个原型系统，这将集中在时尚活动。ScopeMedia将为我们提供多个事件的视频片段。他们还将为我们提供有关此类事件的典型设置以及通常观众需求和兴趣的信息。