Non-Line-of-Sight Detection Based on Neuromorphic Time-of-Flight Sensing
Non-Line-of-Sight Detection Based on Neuromorphic Time-of-Flight Sensing
复制标题
DOI：
10.1021/acsphotonics.3c00448
复制
发表时间：
2023-06
期刊：
影响因子：
7
通讯作者：
Minseong Park;Yuan Yuan-Yuan;Y. Baek;B. Bae;Bo-In Park;Young Hoon Kim;Nicholas Lin;J. Heo;Kyusang Lee
中科院分区：
文献类型：
--
作者：
Minseong Park;Yuan Yuan-Yuan;Y. Baek;B. Bae;Bo-In Park;Young Hoon Kim;Nicholas Lin;J. Heo;Kyusang Lee
非视距 (NLOS) 检测和测距旨在通过感测间接光反射来识别隐藏的物体。尽管已经提出了许多用于非视距检测和成像的计算方法，但外围电路所需的后信号处理仍然很复杂。简化非视距检测和测距的一种可能的解决方案涉及使用神经形态设备，例如忆阻器，其具有固有的电阻切换功能并可以存储时空信息。在本研究中，我们采用忆阻尖峰时序相关的可塑性学习规则将飞行时间 (ToF) 深度信息直接编程到忆阻器介质中。通过将来自源的传输信号与来自目标物体的光电流耦合到单个忆阻器单元中，我们能够根据叠加的两个信号之间的时间间隔感应出可调谐编程脉冲。在这里，这种神经形态 ToF 原理用于检测和测距 NLOS 物体，而不需要复杂的外围电路来处理原始信号。我们通过集成 HfO2 忆阻器和雪崩光电二极管来检测多个方向的 NLOS 物体，通过实验证明了神经形态 ToF 原理的有效性。该技术在汽车导航、机器学习和生物医学工程等各个领域都有潜在的应用。
Non-line-of-sight (NLOS) detection and ranging aim to identify hidden objects by sensing indirect light reflections. Although numerous computational methods have been proposed for NLOS detection and imaging, the post-signal processing required by peripheral circuits remains complex. One possible solution for simplifying NLOS detection and ranging involves the use of neuromorphic devices, such as memristors, which have intrinsic resistive-switching capabilities and can store spatiotemporal information. In this study, we employed the memristive spike-timing-dependent plasticity learning rule to program the time-of-flight (ToF) depth information directly into a memristor medium. By coupling the transmitted signal from the source with the photocurrent from the target object into a single memristor unit, we were able to induce a tunable programming pulse based on the time interval between the two signals that were superimposed. Here, this neuromorphic ToF principle is employed to detect and range NLOS objects without requiring complex peripheral circuitry to process raw signals. We experimentally demonstrated the effectiveness of the neuromorphic ToF principle by integrating a HfO2memristor and an avalanche photodiode to detect NLOS objects in multiple directions. This technology has potential applications in various fields, such as automotive navigation, machine learning, and biomedical engineering.