Looking Around the Corner using Ultrafast Transient Imaging
Looking Around the Corner using Ultrafast Transient Imaging
复制标题
DOI：
10.1007/s11263-011-0470-y
复制
发表时间：
2011-10-01
影响因子：
19.5
通讯作者：
Raskar, Ramesh
中科院分区：
文献类型：
--
作者：
Kirmani, Ahmed;Hutchison, Tyler;Raskar, Ramesh
我们提出了一个新的框架称为瞬态成像的图像形成和场景理解通过脉冲照明和时间图像。使用飞行时间相机和全球光传输的多路径分析，我们开创了通过时间图像进行场景理解的新算法和系统。我们证明，我们提出的瞬态成像框架，使我们能够完成的任务，远远超出了现有的成像技术。例如，人们不仅可以推断出场景中可见部分的几何形状，还可以推断出场景中隐藏部分的几何形状，从而使我们能够看到角落。传统相机估计每像素强度I（x，y）。我们的瞬态成像相机为每个像素捕获3D时间图像I（x，y，t），并使用超短脉冲激光进行照明。新兴的技术正在支持具有皮秒分辨率的每像素时间轮廓的相机，使我们能够捕获超高速时间图像。该时间图像包含在传感器像素处入射的辐照度的时间分布。我们实验证实了我们的理论与自由空间硬件实验，使用飞秒激光和皮秒精度传感设备。推断隐藏场景元素的结构的能力，相机和照明源都无法观察到，将创造一系列新的计算机视觉机会。
We propose a novel framework called transient imaging for image formation and scene understanding through impulse illumination and time images. Using time-of-flight cameras and multi-path analysis of global light transport, we pioneer new algorithms and systems for scene understanding through time images. We demonstrate that our proposed transient imaging framework allows us to accomplish tasks that are well beyond the reach of existing imaging technology. For example, one can infer the geometry of not only the visible but also the hidden parts of a scene, enabling us to look around corners. Traditional cameras estimate intensity per pixel I (x, y). Our transient imaging camera captures a 3D time-image I (x, y, t) for each pixel and uses an ultra-short pulse laser for illumination. Emerging technologies are supporting cameras with a temporal-profile per pixel at picosecond resolution, allowing us to capture an ultra-high speed time-image. This time-image contains the time profile of irradiance incident at a sensor pixel. We experimentally corroborated our theory with free space hardware experiments using a femtosecond laser and a picosecond accurate sensing device. The ability to infer the structure of hidden scene elements, unobservable by both the camera and illumination source, will create a range of new computer vision opportunities.