CMOS image sensor with pixel-wise exposure programmability for computational imaging applications

在过去的十年里，数码相机变得无处不在，主要是因为它们在智能手机中得到了广泛的采用。在过去的十年中，图像传感器设计的进步使2000+百万像素(MP)的图像传感器、高灵敏度和快速成像成为可能；然而，CMOS图像传感器(CI)继续在高级成像应用中受到影响，例如运动去模糊(例如，去除快速汽车的模糊图像)、散焦去模糊(例如，当有多个物体在离相机不同的距离时，前景和背景对焦)和三维(3D)成像。在这一应用中，我们建议使用我们在不列颠哥伦比亚大学开发的技术来构建一种计算型CMOS图像传感器(CIS)，该技术将面向便携式设备市场和智能手机。具体地说，我们将展示我们的技术作为移动设备中的辅助计算摄像头的价值，以在一个集成的传感器芯片中实现像素级高速运动去模糊、三维(3D)焦点堆叠成像和动态范围可调。我们已经在10x10像素阵列中验证了所提出的像素设计的功能。在应用中，我们计划设计、制造和实验验证行业标准四分之一VGA(QVGA)图像传感器(320x240像素阵列)的功能，以及所有所需的外围信号处理电路，所有这些都在同一芯片上。我们还将开发一个使用高分辨率现成图像传感器和我们建议的QVGA图像传感器以及所需软件的双摄像头系统。拟议的CIS将促进在双摄像机设置中执行计算成像算法，作为拟议技术的概念验证。

Digital cameras have become ubiquitous in the past decade, primarily due to their widespread adoption in smartphones. Over the past ten years, advances in the image sensor design have enabled 20+ megapixel (MP) image sensors, high sensitivity, and rapid imaging; however, CMOS image sensors (CISs) continue to suffer in advanced imaging applications such as motion deblurring (e.g., debarring of the blurred image of a fast car), defocus deblurring (e.g., foreground versus background focusing when there are multiple objects in different distances from the camera) and 3 dimensional (3D) imaging. In this application, we propose to build a computational CMOS image sensor (CIS) using the technology we have developed at the University of British Columbia which will target the portable device market and smartphones. Specifically, we will demonstrate the value of our technology as a secondary computational camera in mobile devices to enable pixel-wise high-speed motion deblurring, 3 dimensional (3D) focal-stack imaging, and adjustable dynamic range - all in one integrated sensor chip. We have already verified the functionality of the proposed pixel design in a 10x10 pixel array. In the application, we plan to design, fabricate, and experimentally verify the functionality of a industry standard quarter VGA (QVGA) image sensor (320x240 pixel array) along with all the required peripheral signal processing circuitry, all on the same chip. We also will develop a dual camera system using a high-resolution off-the-shelf image sensor along with our proposed QVGA image sensor along with the required software. The proposed CIS will facilitate performing the computational imaging algorithms in the dual camera setup as a proof-of-concept of the proposed technology.