EAGER: All-Optical Information Processing Device for Seeing Through Diffusers at the Speed of Light

提案编号：2054102主要研究者：Aydogan Ozcan（PI）和莫纳Jarrahi（co-PI）机构：洛杉矶加州大学标题：EAGER：全光学信息处理设备，用于以光速透过漫射器观察程序描述：EAGER：电子，光子学和磁性设备非技术摘要：通过散射和漫射介质（如雾，云或人体组织）成像几十年来一直是一个重要的问题。无一例外，所有以前的方法都是基于，在其核心，数字计算机，这样的信号首先由设备检测，然后使用数字计算机处理，以重建扩散器失真的图像。存在对新一代光学设备的重要且迫切的需求，所述新一代光学设备可以通过例如人体组织、墙壁、包裹、云、雾等看到、检测和量化目标对象，以光速运行，而不需要任何耗电的数字计算。这种独特的能力，一旦充分展示和开发，可能会打开各种新的应用在自治系统，生物医学成像，天文学，天体物理学，大气科学，安全，机器人，和许多其他领域。技术摘要：在这个建议中，一个计算机免费的，全光学设备，将看到通过未知的扩散器在光速，而不需要任何数字计算设备将被开发。与利用计算机来重建未知漫射器后面的输入对象的图像的先前数字方法不同，将使用一组衍射表面/层来创建无源设备，以在漫射器失真的输入信号通过连续训练的衍射层衍射时全光学地重建未知对象的图像，即，图像重建将通过该设备以光速进行处理。设计的给定设备的每个衍射表面将具有数千个衍射特征（称为神经元），其中这些神经元的各个相位值将在训练阶段通过误差反向传播来调整，通过最小化地面实况图像与输出视场处的衍射图案之间的定制损失函数。在这些衍射层的这种基于深度学习的设计之后，将制造所得到的无源器件以形成位于未知漫射器和输出/图像平面之间的物理衍射光学网络。当输入的物体光通过一个未知的漫射器时，散射光将被训练的衍射装置收集以被动地重建失真的图像。该衍射器件的成功将在0.1-3 THz频段得到验证。与其他装置不同，所提出的衍射图像重建装置以光速操作，并且除了照明光之外不需要任何功率。这种将通过被动衍射层实现的全光学图像重建将能够通过未知的漫射器看到物体，并且与现有的基于深度学习或计算机中实现的迭代图像重建方法相比，该设备的功耗极低。该奖项反映了NSF的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。

Proposal Number: 2054102Principal Investigator: Aydogan Ozcan (PI) and Mona Jarrahi (co-PI)Institution: University of California, Los AngelesTitle: EAGER: All-Optical Information Processing Device for Seeing Through Diffusers at the Speed of LightProgram Description: EAGER: Electronics, Photonics, and Magnetic DevicesNon-Technical Abstract:Imaging through scattering and diffusive media such as fog, clouds or human tissue has been an important problem for many decades. Without an exception, all the previous methods are based on, at their core, digital computers, such that the signals are first detected by a device and then processed using digital computers to reconstruct the diffuser-distorted images. There is an important and pressing need for a new generation of optical devices that can see, detect and quantify target objects through for example human tissues, walls, packages, clouds, fogs, etc., at the speed of light and without using any power-hungry digital computation. This unique capability, once fully demonstrated and developed, might open various new applications in autonomous systems, biomedical imaging, astronomy, astrophysics, atmospheric sciences, security, robotics, and many other fields.Technical Abstract:In this proposal, a computer-free, all-optical device that will see through unknown diffusers at the speed of light, without the need for any digital computation device will be developed. Unlike previous digital approaches that utilized computers to reconstruct an image of the input object behind unknown diffusers, a passive device will be created using a set of diffractive surfaces/layers to all-optically reconstruct the image of an unknown object as the diffuser-distorted input signals diffract through successive trained diffractive layers, i.e., the image reconstruction will be processed at the speed of light through this device. Each diffractive surface of a given device designed will have thousands of diffractive features (termed as neurons), where the individual phase values of these neurons will be adjusted in the training phase through error back-propagation, by minimizing a customized loss function between the ground truth image and the diffracted pattern at the output field-of-view. After this deep learning-based design of these diffractive layers, the resulting passive device will be fabricated to form a physical diffractive optical network that is positioned between an unknown diffuser and the output/image plane. As the input object light passes through an unknown diffuser, the scattered light will be collected by the trained diffractive device to passively reconstruct the distorted image. The success of this diffractive device will be demonstrated in 0.1-3 THz frequency band. Unlike other devices, the proposed diffractive image reconstruction device operates at the speed of light and does not require any power except for the illumination light. This all-optical image reconstruction that will be achieved by passive diffractive layers will enable to see objects through unknown diffusers and present an extremely low power device compared with existing deep learning-based or iterative image reconstruction methods implemented in computers.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.