CIF: Small: Signal Processing for Quanta Image Sensors: Reconstruction, Sampling, and Applications

在过去的几十年里，数码相机的普及几乎彻底改变了科学、技术和社会的各个方面。然而，随着我们不断缩小图像传感器以提高空间分辨率并减小相机尺寸，传感器的光子收集部位的尺寸将很快达到基本极限，低于该极限就不能产生有意义的信号。本研究的目的是研究一种新型的图像传感器，称为量子图像传感器（QIS）。与传统的图像传感器相比，QIS提供了更高的空间分辨率，时间分辨率和动态范围。由于这些重要特性，该传感器有可能影响数码相机、消费电子、可穿戴设备、医学成像和物理科学等广泛应用。研究的重点是开发支持QIS的信号处理理论和算法。本研究在前人研究的基础上，特别强调理论与实践的结合。具体问题包括：（1）图像重建。如何在不使用迭代算法的情况下从QIS采集的大量二进制比特流中重建图像？(2)取样.如何控制传感器？的采样机制，在时空分辨率，颜色空间和阈值，以最大限度地提高信噪比？(3)应用程序.如何在不重建图像的情况下使用QIS跟踪快速运动的目标？这项研究的结果将促进新的信号处理技术在光子有限的环境中成像。

The proliferation of digital cameras over the past decades has revolutionized almost every aspect of science, technology and society. However, as we continue to shrink image sensors to increase spatial resolution and reduce camera size, the size of the photon-collecting site of a sensor will soon reach a fundamental limit below which no meaningful signal can be generated. The goal of this research is to investigate a new type of image sensor called the Quanta Image Sensors (QIS). Compared to conventional image sensors, QIS offer substantially higher spatial resolution, temporal resolution, and dynamic range. Because of these important features, the sensor has the potential to impact a wide range of applications in digital cameras, consumer electronics, wearable devices, medical imaging, and physical science. The focus of the research is to develop signal processing theories and algorithms to support QIS. Building upon previous studies in QIS, this research puts extra emphasis on bridging the theories to practice. Specific questions addressed include: (1) Image reconstruction. How to reconstruct images from the massive binary bit-stream collected by the QIS without using iterative algorithms? (2) Sampling. How to control the sensor?s sampling mechanism in spatial-temporal resolution, color space, and threshold to maximize the signal to noise ratio? (3) Application. How to track fast moving objects using QIS without reconstructing images? Results from this research will foster new signal processing techniques for imaging in photon limited environments.