High-quality acquisition and rendering of image-based models for tele-presence in remote environments

网真的目的是创造一种身处遥远地点或环境并与之交互的体验。我们建议通过使用基于图像的模型来创造一种高质量的沉浸式体验，提供“身临其境”的感觉。该项目将通过开发新的采集方法、无缝虚拟导航方法以及在高清电视、自动立体显示器和沉浸式CAVE（房间大小的多屏幕立体投影系统）等设备上传输和显示的方法来推进最先进的技术。该项目的具体目标是：A）开发一个基于图像的高质量模型获取的正式程序，在室外使用人工操作的机动踏板车，在室内使用半自主机器人; B）开发用于部署和增强高质量模型的创作和处理工具;（C）开发先进的计算机视觉技术，在复杂的图像模型内实现平滑和不受约束的导航; D）开发传输和高质量显示模型连续视图的方法。这些目标将有利于加拿大和我们的支助组织。Frontline/Whitebox Robotics预计将从拟议的研究中受益，因为其应用于安全应用中的远程监控和导航。基于拟议的研究，信息技术公司3Vista将能够通过将其3D建筑模型与基于图像的环境集成，为建筑行业的客户提供更高质量的沉浸式体验。我们的目标和我们与传播研究中心的合作对媒体行业非常感兴趣，因为拟议的研究将使3DTV内容的录制，广播和观看成为可能。我们将使用三个应用场景来演示将要开发的技术：a）基于图像的地标公园模型的获取、传输和显示，支持公园内的自由导航; B）基于图像的建筑工地环境与3D建筑模型的增强;以及c）建筑物的虚拟立体漫游。

Tele-Presence aims to create the experience of being at a distant location or environment and interacting with it. We propose to create a high-quality immersive experience that provides the sense of "being there" through the use of image-based models. The project will advance the state-of-the-art by developing new methods for acquisition, for seamless virtual navigation and for transmission and display on devices ranging from HDTVs, auto-stereoscopic monitors to an immersive CAVE (room-sized multi-screen stereo projection system). The specific objectives of the project are: A) Development of a formal procedure for high-quality image-based model acquisition, outdoors with a human-operated motorized scooter and indoors with a semi-autonomous robot; B) Development of authoring and processing tools for the deployment and augmentation of high-quality models; C) Development of advanced computer vision techniques to achieve smooth and unconstrained navigation inside complex image-based models; D) Development of methods for transmission and high-quality display of continuous views of the model. These objectives will be beneficial to Canada and our supporting organizations. Frontline/Whitebox Robotics is expected to benefit from the proposed research because of its application to remote surveillance and navigation in security applications. Based on the proposed research, the information technology company 3Vista will be able to provide its customers in the construction industry a higher quality immersive experience by integrating their 3D architectural models with image-based environments. Our objectives and our collaboration with the Communication Research Centre are of great interest to the media industry because the proposed research will enable the recording, broadcast and viewing of 3DTV content. We will use three application scenarios to demonstrate the technologies to be developed: a) acquisition, transmission and display of an image-based model of a landmark park supporting free navigation inside the park; b) augmentation of an image-based environment of a construction site with 3D architectural models; and c) a virtual stereoscopic fly-through of a building.