Quanta burst photography
Quanta burst photography
复制标题
DOI：
10.1145/3386569.3392470
复制
发表时间：
2020-06
期刊：
影响因子：
--
通讯作者：
Sizhuo Ma;S. Gupta;A. Ulku;C. Bruschini;E. Charbon;Mohit Gupta
中科院分区：
文献类型：
--
作者：
Sizhuo Ma;S. Gupta;A. Ulku;C. Bruschini;E. Charbon;Mohit Gupta
单光子雪崩二极管(SPAD)是一种新兴的传感器技术，能够探测单个入射光子，并以高定时精度捕获它们的到达时间。虽然这些传感器过去仅限于单像素或低分辨率设备，但最近，大型(高达1 MPixel)SPAD阵列已被开发出来。这些单光子相机(SPC)能够捕获高速序列的二进制单光子图像，没有读取噪声。我们介绍了量子猝发摄影，这是一种计算摄影技术，利用SPC作为被动成像设备在具有挑战性的条件下进行摄影，包括超低光和快速运动。受最近传统突发摄影的成功启发，我们设计了一种算法，将SPC捕获的二值序列对齐并合并为强度图像，运动模糊和伪影最小，高信噪比(SNR)和高动态范围。我们从理论上分析了量子猝发摄影的信噪比和动态范围，并确定了它提供显著益处的成像区域。通过最近开发的SPAD阵列，我们证明了所提出的方法能够为具有挑战性的光照、复杂的几何形状、高动态范围和运动目标的场景生成高质量的图像。随着SPAD阵列的不断发展，我们预计量子猝发摄影将在消费和科学摄影中找到应用。
Single-photon avalanche diodes (SPADs) are an emerging sensor technology capable of detecting individual incident photons, and capturing their time-of-arrival with high timing precision. While these sensors were limited to singlepixel or low-resolution devices in the past, recently, large (up to 1 MPixel) SPAD arrays have been developed. These single-photon cameras (SPCs) are capable of capturing high-speed sequences of binary single-photon images with no read noise. We present quanta burst photography, a computational photography technique that leverages SPCs as passive imaging devices for photography in challenging conditions, including ultra low-light and fast motion. Inspired by recent success of conventional burst photography, we design algorithms that align and merge binary sequences captured by SPCs into intensity images with minimal motion blur and artifacts, high signal-to-noise ratio (SNR), and high dynamic range. We theoretically analyze the SNR and dynamic range of quanta burst photography, and identify the imaging regimes where it provides significant benefits. We demonstrate, via a recently developed SPAD array, that the proposed method is able to generate high-quality images for scenes with challenging lighting, complex geometries, high dynamic range and moving objects. With the ongoing development of SPAD arrays, we envision quanta burst photography finding applications in both consumer and scientific photography.