CAREER: Integrated systems for light field capture and analysis

该项目的目标是开发集成的低成本系统，能够捕获和表征3d场景中的光，同时最大限度地减少或消除对片外计算的需求。本研究的智力价值在于理解了使用衍射角敏感像素来分析光场的成像系统的能力和局限性。这包括：1)开发场景统计如何在角度敏感像素阵列的输出统计中反映的模型，从而开发算法来提取关于场景的有用信息，例如深度，3d方向运动和物体识别。2)了解如何优化角度敏感像素阵列来编码不同焦深的场景，以及如何最好地部署信号选择、调理和处理电路来利用这些阵列？编码真实场景时的信号属性。3)研究新的集成衍射结构，提高ASP量子效率和空间分辨率，并以新的方式过滤光场。这项研究的广泛影响将包括增强成像系统在安全、自动化、卫生保健和科学研究中的应用，从野生动物跟踪到显微镜。这项工作还将通过提供消费电子产品的新功能来影响商业领域，帮助促进经济增长。由于这些系统使用标准的CMOS制造，因此可以以非常低的尺寸和成本批量生产，因此这些影响会增加。这项研究提供了一个简单易懂的例子，低级物理驱动有用的高级功能，为招聘和激励未来的工程师提供了引人注目的例子。

The objective of this project is to develop integrated, low cost systems able to capture and characterize light from 3-D scenes while minimizing or eliminating the need for off-chip computation. The intellectual merit of this research is in understanding the capabilities and limitations of imaging systems using diffractive angle-sensitive pixels to analyze the light field. This includes: 1) Developing models of how scene statistics are reflected in the output statistics of angle sensitive pixel arrays, and so developing algorithms to extract useful information about the scene, such as depth, 3-D directional motion, and object recognition. 2) Understanding how to optimize arrays of angle sensitive pixels to encode scenes at various focal depths, as well as how to best deploy signal selection, conditioning and processing circuits to take advantage of these arrays? signal properties when encoding real scenes. 3) Investigating new integrated diffractive structures that enhance ASP quantum efficiency and spatial resolution, and that filter the light field in new ways. The broader impacts of this research will include enhanced imaging systems with applications in security, automation, health care, and scientific research, from wildlife tracking to microscopy. This work will also impact the commercial sphere by providing new capabilities in consumer electronics, helping to boost economic growth. These impacts are increased because these systems use standard CMOS manufacturing, and so can be mass-produced at very low size and cost. This research provides an easily-understood example of low-level physics driving useful high-level function, providing compelling examples for recruiting and inspiring future engineers.