Active Computational Imaging Using a Dense Array of Projectors and Cameras

使用密集的投影仪和相机阵列进行主动计算成像

• 批准号: 0540872
• 负责人: Marc Levoy
• 金额: --
• 依托单位: Stanford University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2006
• 资助国家: 美国
• 起止时间: 2006-02-15 至 2010-03-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0540872&HistoricalAwards=false
• 关键词: Active; Computational; Imaging; Using; Dense

Although arrays of cameras have existed in various forms for more than a century, arrays of projectors have been limited by available technology to small numbers of devices. As the number of projectors that can be feasibly assembled into an array increases, one can begin to treat the illumination produced by the array as a light field - radiance as a function of ray position and direction in free space. The light field has been studied abstractly by numerous researchers; however, physical systems for generating light fields have been severely limited in resolution by the cost and size of projectors. The investigators are building an array of 128 miniature, SVGA-resolution video projectors, and will interleave these projectors with an existing array of 128 video cameras, thereby producing a device that can both record and generate light fields - a fundamentally new capability. These new techniques will yield new methodologies for image-based modeling, inspection and motion capture and will have applications in areas such as in entertainment, archaeology, and modeling and simulation for training and mission rehearsal.Using the existing camera array the investigators have studied several types of high-performance imaging, including high-speed videography, synthetic aperture photography, and tiled panoramic imaging. Using the new hybrid array,they will explore two additional problems: (1) Measuring the 3D shape of an object from every direction at once, meaning capturing all sides of the object in parallel. No existing technology can do this, at least not at optical wavelengths. The goals are near-instantaneous shape capture of a moving object and full-shape motion capture of moving objects. (2) Illumination of physical objects non-photorealistically, to enhance their appearance as seen by a human observer. Examples include recoloring, cloaking, or illumination that is everywhere-perpendicular or everywhere-grazing to the surface of the object.

尽管相机阵列已经以各种形式存在了一个多世纪，但投影仪阵列一直受到现有技术的限制，只能用于少量设备。 随着可以组装成阵列的投影仪数量的增加，人们可以开始将阵列产生的照明视为光场 - 辐射亮度作为自由空间中光线位置和方向的函数。 许多研究人员已经对光场进行了抽象研究；然而，用于生成光场的物理系统的分辨率受到投影仪的成本和尺寸的严重限制。研究人员正在建造一个由 128 个微型 SVGA 分辨率视频投影仪组成的阵列，并将这些投影仪与现有的由 128 个摄像机组成的阵列交织在一起，从而生产出一种既可以记录又可以生成光场的设备——这是一种全新的功能。这些新技术将为基于图像的建模、检查和动作捕捉带来新的方法，并将在娱乐、考古、训练和任务演练的建模和模拟等领域得到应用。研究人员利用现有的相机阵列研究了几种类型的高性能成像，包括高速摄像、合成孔径摄影和平铺全景成像。 使用新的混合阵列，他们将探索另外两个问题：(1) 从各个方向同时测量物体的 3D 形状，这意味着并行捕获物体的所有侧面。 现有技术无法做到这一点，至少在光波长上无法做到这一点。 目标是移动物体的近乎瞬时形状捕捉和移动物体的全形状运动捕捉。 (2) 对物理对象进行非真实感照明，以增强人类观察者所看到的外观。 示例包括重新着色、隐身或无处不在（垂直或无处不在）掠过对象表面的照明。