High-quality acquisition and rendering of image-based models for tele-presence in remote environments

远程呈现旨在创造一种身处遥远地点或环境并与之互动的体验。我们建议通过使用基于图像的模型来创造一种高质量的沉浸式体验，提供“身临其境”的感觉。该项目将通过开发新的采集方法、无缝虚拟导航、传输和显示设备（从高清电视、自动立体显示器到沉浸式CAVE（房间大小的多屏幕立体投影系统））来推进最先进的技术。该项目的具体目标是：A)开发高质量基于图像的模型采集的正式程序，室外使用人工操作的电动滑板车，室内使用半自动机器人；B)开发用于部署和增强高质量模型的创作和处理工具；C)开发先进的计算机视觉技术，在复杂的基于图像的模型中实现平滑和无约束的导航；D)开发模型连续视图的传输和高质量显示方法。这些目标将有利于加拿大和我们的支持组织。前线/白盒机器人公司有望从拟议的研究中受益，因为它在安全应用中的远程监视和导航应用。基于拟议的研究，信息技术公司3Vista将能够通过将其3D建筑模型与基于图像的环境相结合，为建筑行业的客户提供更高质量的沉浸式体验。传媒业界对我们的目标和我们与传播研究中心的合作非常感兴趣，因为拟议的研究将使3d电视内容的录制、广播和观看成为可能。我们将使用三个应用场景来演示有待开发的技术：a)获取、传输和显示支持公园内自由导航的地标性公园图像模型；b)利用三维建筑模型增强建筑工地的图像环境；c)建筑的虚拟立体飞行。

Tele-Presence aims to create the experience of being at a distant location or environment and interacting with it. We propose to create a high-quality immersive experience that provides the sense of "being there" through the use of image-based models. The project will advance the state-of-the-art by developing new methods for acquisition, for seamless virtual navigation and for transmission and display on devices ranging from HDTVs, auto-stereoscopic monitors to an immersive CAVE (room-sized multi-screen stereo projection system). The specific objectives of the project are: A) Development of a formal procedure for high-quality image-based model acquisition, outdoors with a human-operated motorized scooter and indoors with a semi-autonomous robot; B) Development of authoring and processing tools for the deployment and augmentation of high-quality models; C) Development of advanced computer vision techniques to achieve smooth and unconstrained navigation inside complex image-based models; D) Development of methods for transmission and high-quality display of continuous views of the model. These objectives will be beneficial to Canada and our supporting organizations. Frontline/Whitebox Robotics is expected to benefit from the proposed research because of its application to remote surveillance and navigation in security applications. Based on the proposed research, the information technology company 3Vista will be able to provide its customers in the construction industry a higher quality immersive experience by integrating their 3D architectural models with image-based environments. Our objectives and our collaboration with the Communication Research Centre are of great interest to the media industry because the proposed research will enable the recording, broadcast and viewing of 3DTV content. We will use three application scenarios to demonstrate the technologies to be developed: a) acquisition, transmission and display of an image-based model of a landmark park supporting free navigation inside the park; b) augmentation of an image-based environment of a construction site with 3D architectural models; and c) a virtual stereoscopic fly-through of a building.