Integrated Sensing: Acquisition, Compression and Interpolation of Panoramic Stereo Images of a Scene for Remote Walkthroughs

集成传感：用于远程演练的场景全景立体图像的采集、压缩和插值

• 批准号: 0225523
• 负责人: Narendra Ahuja
• 金额: $ 25万
• 依托单位: University of Illinois at Urbana-Champaign
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2002
• 资助国家: 美国
• 起止时间: 2002-08-15 至 2005-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0225523&HistoricalAwards=false
• 关键词: Integrated; Sensing; Acquisition; Compression; Interpolation

This proposal is aimed at producing novel images of a scene from arbitrary new viewpoints using a sparse set of compressed panoramic snapshots or sample images of the scene. The samples are taken from a relatively small number of strategically placed cameras. A major application and evaluation testbed of the proposed work is to enable walkthroughs of a 3D scene by generating the images of the scene along a trajectory dynamically chosen by a remote user. The focus of the proposed work is on the acquisition of panoramic stereo images which serve as scene samples, and their interpolation (or extrapolation) for producing a new stereo pair of images of the scene from an arbitrary new viewpoint. The user follows a dynamically chosen arbitrary trajectory and wishes to continuously teleview the scene from along the trajectory points. It is assumed that relative locations of the objects in the scene for which walkthroughs are to be generated are known; the object locations are sparse; and that the strategic placement of the cameras does not change significantly to warrant camera replacement. Development and implementation of a stereo panoramic camera is proposed. Limited work is proposed on joint image compression. The topology of the camera network also allows the determination of which cameras are to be used to generate the walkthrough image at any given point along the user drawn trajectory. Applications of the proposed work include video surveillance, virtual museums and video conferencing.

该建议旨在使用场景的压缩全景快照或样本图像的稀疏集合从任意新视点产生场景的新颖图像。这些样本是从数量相对较少的战略性放置的相机中获取的。一个主要的应用程序和评估测试平台的建议的工作是，使步行的3D场景生成的图像的场景沿着动态选择的轨迹由远程用户。所提出的工作的重点是作为场景样本的全景立体图像的采集，以及它们的插值（或外推），用于从任意新的视点产生场景的图像的新的立体对。用户遵循动态选择的任意轨迹并且希望从沿着轨迹点连续地电视观看场景。假设场景中要生成漫游的对象的相对位置是已知的;对象位置是稀疏的;并且摄像机的策略放置不会显著改变以保证摄像机更换。提出了一种立体全景摄像机的研制方案。有限的工作提出了联合图像压缩。摄像机网络的拓扑结构还允许确定哪些摄像机将被用于在沿着沿着用户绘制的轨迹的任何给定点处生成穿行图像。拟议工作的应用包括视频监控，虚拟博物馆和视频会议。