Dappled photography: mask enhanced cameras for heterodyned light fields and coded aperture refocusing
Dappled photography: mask enhanced cameras for heterodyned light fields and coded aperture refocusing
复制标题
DOI：
10.1145/1275808.1276463
复制
发表时间：
2007-07
期刊：
影响因子：
--
通讯作者：
A. Veeraraghavan;R. Raskar;Amit K. Agrawal;Ankit Mohan;J. Tumblin
中科院分区：
文献类型：
--
作者：
A. Veeraraghavan;R. Raskar;Amit K. Agrawal;Ankit Mohan;J. Tumblin
我们描述了一个理论框架，用于可逆地调制4D光场使用衰减掩模在基于透镜的相机的光路中。基于这个框架，我们提出了一种新的设计，重建4D光场从一个2D的相机图像，没有任何额外的折射元件所需的以前的光场相机。图案化的掩模衰减相机内部的光线而不是弯曲它们，并且衰减可恢复地编码2D传感器上的光线。我们的配备掩膜的相机与传统相机一样聚焦，以全传感器分辨率拍摄传统的2D照片，但原始像素值也保持调制的4D光场。可以通过将传感器值的2D傅立叶变换的瓦片重新布置到4D平面中并计算逆傅立叶变换来恢复光场。此外，还可以恢复场景的焦点对准部分的全分辨率图像信息。我们还展示了如何放置在透镜的宽带掩模使我们能够计算分层朗伯场景在全传感器分辨率下的重聚焦图像。4D光线空间数据的这种部分编码使得能够通过深度编辑图像内容，而不需要计算恢复完整的4D光场。
We describe a theoretical framework for reversibly modulating 4D light fields using an attenuating mask in the optical path of a lens based camera. Based on this framework, we present a novel design to reconstruct the 4D light field from a 2D camera image without any additional refractive elements as required by previous light field cameras. The patterned mask attenuates light rays inside the camera instead of bending them, and the attenuation recoverably encodes the rays on the 2D sensor. Our mask-equipped camera focuses just as a traditional camera to capture conventional 2D photos at full sensor resolution, but the raw pixel values also hold a modulated 4D light field. The light field can be recovered by rearranging the tiles of the 2D Fourier transform of sensor values into 4D planes, and computing the inverse Fourier transform. In addition, one can also recover the full resolution image information for the in-focus parts of the scene. We also show how a broadband mask placed at the lens enables us to compute refocused images at full sensor resolution for layered Lambertian scenes. This partial encoding of 4D ray-space data enables editing of image contents by depth, yet does not require computational recovery of the complete 4D light field.