Rush in 3D

点击翻译按钮获取中文摘要

In cooperation with Anthem / SRO , the applicant wishes to lay the groundwork for a free-viewpoint video. This would allow users to visualize the performance of the iconic Canadian rock band Rush in 3 dimensions, with the ability to pilot a virtual drone-like camera around a rendered 3D version of the stage. Development of the video would begin by using video of the musicians as they perform on stage, from a large array of cameras embedded in and around the stage. This step has already been performed, in collaboration with GoPro Inc. and CamDo Inc. From the 50 different points of view recorded at one concert (Calgary, 15 July 2015), we will refine 3D reconstruction techniques to reconstruct their performance as an animated 3D model. Furthermore, the video capture is noisy (vibrations of all kinds, partly obscured views, alternating bright and dark lighting, fireworks, etc), and thus novel machine learning algorithms will be used to filter out this noise. Anthem / SRO wishes to partner with McMaster as there are rather significant technical hurdles to overcome in all stages of the development of such a software application. They do not have either the expertise or technology for the visual aspects. Dr. Carette, through his G-ScalE lab, does.