Smart Pixels with Smart Illumination

带有智能照明的智能像素（SPSI）是一种新的图像传感器和处理方法。最近，蒙大拿州立大学的Babbitt教授和华盛顿大学的Darling教授提出了SPSI概念，该概念涉及通过检测图像的反馈来动态控制物体的空间和时间照明。SPSI传感器的光学设计使从远程物体散射的智能发射器阵列发出的光能够光学耦合回智能光电探测器阵列，即使发射器和探测器在空间和电子上是集成的。集成的发射器和探测器可以实现动态和高效的照明，并在逐像素的基础上感应远程物体，从而增强图像处理能力和一些全新的传感器设计。SPSI在传感器阵列技术中的一些潜在应用包括边缘检测；动态聚光灯跟踪系统；一种跟踪传感器，监视划线线的焦点、平移和旋转；赢家通吃的神经网络会突出“获胜”像素；荧光物体的精确跟踪；强度压缩算法；面向页面的存储和处理系统中的跟踪、差分传感和纠错逐像素背景减法；该提案是由蒙大拿州立大学的Babbitt教授和华盛顿大学的Darling教授合作撰写的，他们同时提交了具有相同技术部分的提案，但各自的预算和支持各自机构的数据。这两项建议是相互关联的，应共同审查，因为每个机构的工作都依赖于另一个机构的专门知识贡献，以实现拟议的目标。对于研究计划中的每项任务，确定对其完成负有主要责任的机构。该计划的总体目标是将SPSI概念及其潜在应用从萌芽阶段发展为定义良好且实用的传感器系统。提出的计划的研究目标是：1)形式化提出的SPSI应用程序的设计，2)对其性能进行建模，3)设计和制造SPSI所需的电子和光学元件，4)展示那些具有最有前途属性的实现，5)为SPSI概念的未来发展制定计划。研究计划该计划从参与VCSEL代工服务的SPSI概念的接受中受益匪浅，该服务免费提供集成VCSEL/MSM阵列，定制CMOS处理芯片，定制衍射光学元件和定制透镜阵列。最初的研究工作将集中在这些元件的设计和利用上，基于我们对集成led和MSM探测器的初步研究结果，这些结果展示了核心SPSI光学和电子反馈机制。新的电子和光学器件将根据需要进行设计、制造和整合。其他集成技术的进步，包括达林教授正在开发的蓝宝石上硅技术，将被用于优化SPSI传感器的性能。该研究项目将需要对电子和光学器件进行广泛的设计、制造和测试，因此，Babbitt教授在光学设计和加工方面的专业知识和Darling教授在电子和光电子设计和制造方面的专业知识的合作将得到加强

9871479DarlingSmart Pixels with Smart Illumination Smart pixels with smart illumination (SPSI) is a new approach to image sensor and processing. The SPSI concept, recently proposed by Prof Babbitt of Montana State University and Prof. Darling of the University of Washington, involves the dynamic control of the spatial and temporal illumination of an object via feedback from the detected image. The optical design of a SPSI sensor enables the light from an array of smart emitters that scatters off a remote object to be optically coupled back to an array of smart photodetectors, even if the emitters and detectors are spatially and electronically integrated. Integrated emitters and detectors enable dynamic and efficient illumination and sensing off remote objects on a pixel by pixel basis, leading to enhanced image processing capabilities and some radically new sensor designs. Some of the potential SPSI applications in sensor array technology include edge detection; dynamic spotlight tracking- system; a tracking- sensor that monitors focus, translation, and rotation of a scribe line; winner-take-all neural networks that highlights the "winning" pixel; precise tracking of fluorescent objects; intensity compression algorithms; tracking, differential sensing, and error correction in page oriented memory andprocessing systems; pixel by pixel background subtraction; and ranging-ZD ISimultaneous Submissions of Proposals This proposal was written collaboratively by Prof. Babbitt of Montana State University and Prof. Darling of the University of Washington, who are simultaneously submitting proposals with the same technical sections, but with separate budgets and supporting data for their respective institution. The two proposals are coupled and should be reviewed jointly, as the work of each institution relies on the expertise contribution of the other institution to achieve the proposed objectives. For each task in the research plan, the institution that has primary responsibility for its completion is identified.Program Objectives The overall objective of the proposed program is the development of the SPSI concept and its potential applications from their embryonic stage to well defined and practical sensor systems. The research objectives of the proposed program are to 1) formalize the design of proposed SPSI applications, 2) model their performance, 3) design and fabricate the electronic and optical elements needed for SPSI, 4) demonstrate those implementations with the most promising attributes, and 5) map out a plan for future development of the SPSI concept.Research Plan The proposed program benefits greatly from the acceptance of the SPSI concept for participation in the VCSEL Foundry Service, which supplies at no cost an integrated VCSEL/MSM array, a custom CMOS processing chip, a custom diffractive optical element, and a custom lenslet array. The initial research effort will focus on the design and utilization of these elements, building on our initial results with inteorated LEDs and MSM detectors, which demonstrated the core SPSI optical and electronic feedback mechanisms. New electronic and optical devices will be designed, fabricated, and incorporated as needed. Advances in other integration technologies, including the silicon on sapphire technology being developed by Prof. Darling, will be examined and utilized to optimize SPSI sensor performance. The research program will require extensive design, fabrication, and testing of both electronic and optical devices and is thus strengthened by the collaboration between Prof. Babbitt, with his expertise in optical design and processing, and Prof. Darling, with his expertise in electronic and optoelectronic design and fabrication.***