Rush in 3D

3D 冲刺

• 批准号: 488542-2015
• 负责人: Carette, Jacques
• 金额: $ 1.82万
• 依托单位: McMaster University
• 依托单位国家: 加拿大
• 项目类别: Engage Grants Program
• 财政年份: 2015
• 资助国家: 加拿大
• 起止时间: 2015-01-01 至 2016-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=586292
• 关键词: Rush; 3D

In cooperation with Anthem / SRO , the applicant wishes to lay the groundwork for a free-viewpoint video. This would allow users to visualize the performance of the iconic Canadian rock band Rush in 3 dimensions, with the ability to pilot a virtual drone-like camera around a rendered 3D version of the stage. Development of the video would begin by using video of the musicians as they perform on stage, from a large array of cameras embedded in and around the stage. This step has already been performed, in collaboration with GoPro Inc. and CamDo Inc. From the 50 different points of view recorded at one concert (Calgary, 15 July 2015), we will refine 3D reconstruction techniques to reconstruct their performance as an animated 3D model. Furthermore, the video capture is noisy (vibrations of all kinds, partly obscured views, alternating bright and dark lighting, fireworks, etc), and thus novel machine learning algorithms will be used to filter out this noise. Anthem / SRO wishes to partner with McMaster as there are rather significant technical hurdles to overcome in all stages of the development of such a software application. They do not have either the expertise or technology for the visual aspects. Dr. Carette, through his G-ScalE lab, does.

与Anthem / SRO合作，申请人希望为自由视点视频奠定基础。 这将允许用户以三维方式可视化加拿大摇滚乐队Rush的表演，并能够在舞台的3D渲染版本周围驾驶虚拟无人机摄像机。 视频的开发将开始使用音乐家在舞台上表演时的视频，这些视频来自嵌入舞台及其周围的大量摄像机。这一步骤已经与GoPro Inc.合作执行。关于CamDo Inc.从一场音乐会（卡尔加里，2015年7月15日）记录的50个不同的角度来看，我们将改进3D重建技术，以将其表现重建为动画3D模型。此外，视频捕获是嘈杂的（各种振动，部分模糊的视图，交替的明暗照明，烟花等），因此将使用新颖的机器学习算法来过滤掉这种噪声。 Anthem / SRO希望与McMaster合作，因为在开发此类软件应用程序的所有阶段都有相当重要的技术障碍需要克服。他们没有视觉方面的专业知识或技术。Carette博士通过他的G-Scale实验室做到了。