Integrated Sensing: Acquisition, Compression and Interpolation of Panoramic Stereo Images of a Scene for Remote Walkthroughs

该方案的目的是使用场景的稀疏全景快照或样本图像，从任意新的视点生成场景的新颖图像。样本取自数量相对较少的战略放置的摄像头。所提出的工作的主要应用和评估试验台是通过沿着远程用户动态选择的轨迹生成场景的图像来实现3D场景的漫游。提出的工作的重点是获取作为场景样本的全景立体图像，以及它们的内插(或外推)以从任意新的视点产生场景的新的立体图像对。用户遵循动态选择的任意轨迹，并且希望沿着轨迹点连续地远程观看场景。假设要为其生成漫游的场景中的对象的相对位置是已知的；对象位置是稀疏的；并且相机的战略放置不会显著改变以保证相机更换。介绍了一种立体全景相机的开发与实现。目前关于联合图像压缩的研究工作还很有限。相机网络的拓扑还允许确定使用哪些相机来沿着用户绘制的轨迹在任何给定点生成漫游图像。拟议工作的应用包括视频监控、虚拟博物馆和视频会议。

This proposal is aimed at producing novel images of a scene from arbitrary new viewpoints using a sparse set of compressed panoramic snapshots or sample images of the scene. The samples are taken from a relatively small number of strategically placed cameras. A major application and evaluation testbed of the proposed work is to enable walkthroughs of a 3D scene by generating the images of the scene along a trajectory dynamically chosen by a remote user. The focus of the proposed work is on the acquisition of panoramic stereo images which serve as scene samples, and their interpolation (or extrapolation) for producing a new stereo pair of images of the scene from an arbitrary new viewpoint. The user follows a dynamically chosen arbitrary trajectory and wishes to continuously teleview the scene from along the trajectory points. It is assumed that relative locations of the objects in the scene for which walkthroughs are to be generated are known; the object locations are sparse; and that the strategic placement of the cameras does not change significantly to warrant camera replacement. Development and implementation of a stereo panoramic camera is proposed. Limited work is proposed on joint image compression. The topology of the camera network also allows the determination of which cameras are to be used to generate the walkthrough image at any given point along the user drawn trajectory. Applications of the proposed work include video surveillance, virtual museums and video conferencing.