CAREER: Multimodal Photodetectors

职业：多模态光电探测器

• 批准号: 1749050
• 负责人: Zongfu Yu
• 金额: $ 50万
• 依托单位: University of Wisconsin-Madison
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-03-01 至 2023-02-28
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1749050&HistoricalAwards=false
• 关键词: CAREER; Multimodal; Photodetectors

Machine intelligence has acquired unprecedented power with the recent progress of deep learning. When paired with sensory functions, autonomous machines with even rudimentary intelligence are expected to revolutionize the world's economy. Today, the vision that most machines have is based on traditional intensity pictures of a scene, just as humans use. This vision modality has many limitations: it is impaired by fog and rain, and it offers no spectral information other than combinations of three fundamental colors. These issues greatly limit the practical use of autonomous machines due to their stringent safety and reliability requirements. As a result, expensive optical instruments are being used to assist conventional vision in accomplishing special tasks. The proposed project has the potential to overcome the fundamental issues of traditional imaging technologies. It is based on a new type of light-sensing pixels that can measure multimodal information of light, such as incident angle, wavelength, and phase. They could offer unprecedented scene awareness for pervasive use in future machines.Light-sensitive pixels used in today's camera can only detect the intensity of light. The intensity information is sufficient for conventional applications such as photography, its limitations become apparent in advanced vision tasks. This project will develop a new class of photodetectors to measure multimodal information of light waves. They are compact and can form high density arrays as imaging chips. Although multimodal information can be measured through conventional optical components, such as lenses, prisms, and gratings, these components are expensive to integrate. They also degrade spatial resolution and decrease operational speed. This project uses novel nanostructures to exploit unique optical interactions. Multi-modal pixels will be designed using full wave simulation and fabricated with photo-lithography. The multimodal pixels are completely compatible with existing semiconductor fabrication facilities and could potentially be mass-produced at the cost of consumer electronics. The project will also develop new machine learning algorithms to exploit multimodal information to perform vision tasks far beyond those possible with today's intensity-only approach.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

随着深度学习的最新进展，机器智能获得了前所未有的力量。当与感官功能相结合时，即使具有基本智能的自主机器也有望彻底改变世界经济。如今，大多数机器的视觉都是基于场景的传统强度图片，就像人类使用的那样。这种视觉方式有很多局限性：它会受到雾和雨的影响，并且除了三种基本颜色的组合之外，它不提供光谱信息。由于其严格的安全性和可靠性要求，这些问题极大地限制了自主机器的实际使用。因此，昂贵的光学仪器被用来辅助传统视觉完成特殊任务。该项目有潜力克服传统成像技术的基本问题。它基于一种新型光传感像素，可以测量光的多模态信息，例如入射角、波长和相位。它们可以提供前所未有的场景感知，以便在未来的机器中普遍使用。当今相机中使用的光敏像素只能检测光的强度。强度信息足以满足摄影等传统应用的需求，但其局限性在高级视觉任务中变得明显。该项目将开发一种新型光电探测器来测量光波的多模态信息。它们结构紧凑，可以形成高密度阵列作为成像芯片。尽管多模态信息可以通过传统的光学元件（例如透镜、棱镜和光栅）进行测量，但这些元件的集成成本很高。它们还会降低空间分辨率并降低运行速度。该项目使用新颖的纳米结构来开发独特的光学相互作用。多模态像素将使用全波模拟进行设计，并通过光刻技术进行制造。多模态像素与现有的半导体制造设施完全兼容，并且有可能以消费电子产品的成本进行大规模生产。该项目还将开发新的机器学习算法，以利用多模态信息来执行远远超出当今仅强度方法所能完成的视觉任务。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Single-shot on-chip spectral sensors based on photonic crystal slabs

• DOI: 10.1038/s41467-019-08994-5
• 发表时间: 2019-03-04
• 期刊: NATURE COMMUNICATIONS
• 影响因子: 16.6
• 作者: Wang, Zhu;Yi, Soongyu;Yu, Zongfu
• 通讯作者: Yu, Zongfu