CAREER: 4D mm-Wave Compressive Sensing and Imaging at One Thousand Volumetric Frames per Second

职业：每秒一千个体积帧的 4D 毫米波压缩传感和成像

• 批准号: 1653671
• 负责人: Jose Martinez-Lorenzo
• 金额: $ 50万
• 依托单位: Northeastern University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-03-01 至 2022-02-28
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1653671&HistoricalAwards=false
• 关键词: CAREER; 4D; mm; Wave; Compressive

Millimeter-wave sensing and imaging systems are used ubiquitously for a wide range of applications, such as atmospheric sounding of the earth to forecast the weather, security monitoring to detect potential threats at airport checkpoints, and biological imaging of superficial tissues for wound diagnosis and healing. These systems typically operate well when the scene dynamics do not change rapidly. Unfortunately this is not the case in emerging societally-important applications like swarms of drones in rescue missions, smart self-driving cars on roadways, or cyber-physical systems searching for suicide bombers when they are on the move. This project will benefit our society with the development of the first four-dimensional (4D) millimeter-wave imaging system operating in fast changing scenarios, in which safety-critical decisions must be made quickly. One of the new applications of this system will be finding security threats, concealed under clothing or inside backpacks, in open areas like shopping malls, sport venues, and office buildings. Specifically, the system will have the capability to scan multiple people moving within a volumetric region of 26 cubic meters, producing 1000 image frames per second in three dimensions, thus outperforming existing millimeter-wave sensing and imaging systems that are currently used at airport checkpoints. In addition to the societal impact, the Principal Investigator (PI) will build a strong educational program through which diverse audiences can understand the principles and limitations of wave-based imaging systems. The integration of research and education will be accomplished through the development of new curricula and research training methods for students, as well as through the elaboration of a roadmap for transitioning students into industry, in collaboration with Northeastern University (NEU) Cooperative Education Program. The outreach plan includes enabling research experiences for K-12, undergraduate, and underrepresented students in collaboration with the Science, Technology, Engineering, and Mathematics (STEM) centers at NEU, as well as education through online materials and public venues.The research goal of this CAREER program is to understand the theoretical principles and fundamental limitations of adaptable compressive sensing and imaging systems using 4D (temporal and spatial) coding and to develop and experimentally validate these principles through a novel 4D millimeter-wave adaptive compressive imaging radar system. This system will produce 4D volumetric frame rates beyond 1000 frames per second, each frame having over one million pixels. The primary challenges of implementing 4D adaptable imaging systems are the following: 1) the system must be capable of handling variable dynamics, i.e., objects moving with different velocities and located at different focal ranges; 2) the system must sample data with sufficient signal to noise ratio during the limited period of time; and 3) the system must sample data extremely fast to perform fast 4D video reconstruction with high volumetric frame rates. This project will address these challenges as follows: (i) it will develop a new theory that brings together functional analysis, information theory, compressive sensing, and adaptable metamaterials to enhance the information transfer efficiency of sensing systems; (ii) it will develop a new mathematical framework to optimize 4D codes based on the desired information rate and energy efficiency of the compressive imaging system; and (iii) the system will utilize spatial light modulators, vortex-meta-lenses, and compressive reflectors to perform the coding and to dynamically adapt to the state of the imaging region. The result of this research will establish the scientific basis for the proposed new sensing and imaging systems, by enhancing the imaging performance, reliability, and efficiency while reducing the hardware complexity, overall cost, and energy consumption of the system.

毫米波传感和成像系统广泛用于各种应用，例如通过地球大气探测来预测天气、通过安全监控来检测机场检查站的潜在威胁，以及通过浅表组织的生物成像来诊断和愈合伤口。当场景动态不快速变化时，这些系统通常运行良好。不幸的是，在新兴的对社会重要的应用中，情况并非如此，例如执行救援任务的无人机群、道路上的智能自动驾驶汽车或在移动时搜索自杀式炸弹袭击者的网络物理系统。该项目将通过开发第一个在快速变化的场景中运行的四维（4D）毫米波成像系统来造福我们的社会，在这种场景中必须快速做出安全关键决策。该系统的新应用之一是在购物中心、体育场馆和办公楼等开放区域发现隐藏在衣服下或背包内的安全威胁。具体来说，该系统将能够扫描在 26 立方米的体积区域内移动的多人，每秒生成 1000 个三维图像帧，从而优于目前在机场检查站使用的现有毫米波传感和成像系统。除了社会影响之外，首席研究员（PI）还将建立一个强大的教育计划，通过该计划，不同的受众可以了解基于波的成像系统的原理和局限性。研究与教育的整合将通过与东北大学（NEU）合作教育项目合作，为学生开发新课程和研究培训方法，以及制定学生进入工业界的路线图来实现。外展计划包括与东北大学科学、技术、工程和数学 (STEM) 中心合作，为 K-12、本科生和代表性不足的学生提供研究经验，以及通过在线材料和公共场所进行教育。该职业计划的研究目标是了解使用 4D（时间和空间）编码的适应性压缩传感和成像系统的理论原理和基本局限性，并开发和 通过新型 4D 毫米波自适应压缩成像雷达系统对这些原理进行实验验证。该系统将产生每秒超过 1000 帧的 4D 体积帧速率，每帧具有超过 100 万像素。实现 4D 自适应成像系统的主要挑战如下： 1）系统必须能够处理可变动态，即以不同速度移动并位于不同焦距的物体； 2）系统必须在有限的时间内以足够的信噪比采样数据； 3) 系统必须极快地采样数据，才能以高体积帧速率执行快速 4D 视频重建。该项目将解决以下挑战：（i）它将开发一种新理论，将功能分析、信息论、压缩感知和适应性超材料结合在一起，以提高传感系统的信息传输效率； (ii) 它将开发一个新的数学框架，根据压缩成像系统所需的信息率和能量效率来优化 4D 代码； (iii) 该系统将利用空间光调制器、涡旋超透镜和压缩反射器来执行编码并动态适应成像区域的状态。这项研究的结果将为所提出的新型传感和成像系统奠定科学基础，提高成像性能、可靠性和效率，同时降低系统的硬件复杂性、总体成本和能耗。

项目成果

Single-Frequency Imaging and Material Characterization Using Reconfigurable Reflectarrays

使用可重构反射阵列的单频成像和材料表征

• DOI: 10.1109/tmtt.2021.3061597
• 发表时间: 2021
• 期刊: IEEE Transactions on Microwave Theory and Techniques
• 影响因子: 4.3
• 作者: Zhang, Weite;Gomez-Sousa, Hipolito;Heredia-Juesas, Juan;Martinez-Lorenzo, Jose A.
• 通讯作者: Martinez-Lorenzo, Jose A.

Fast Source Reconstruction via ADMM with Elastic Net Regularization

通过具有弹性网络正则化的 ADMM 进行快速源重建

• DOI: 10.1109/apusncursinrsm.2018.8608521
• 发表时间: 2018
• 期刊: 2018 IEEE International Symposium on Antennas and Propagation & USNC/URSI National Radio Science Meeting
• 作者: Heredia-Juesas, Juan;Tirado, Luis;Martinez-Lorenzo, Jose A.
• 通讯作者: Martinez-Lorenzo, Jose A.

Toward 4-D Imaging of On-the-Move Object at 2500 Volumetric Frames per Second by Software-Defined Millimeter-Wave MIMO With Compressive Reflector Antenna

• DOI: 10.1109/tmtt.2022.3213640
• 发表时间: 2023-03
• 期刊: IEEE Transactions on Microwave Theory and Techniques
• 影响因子: 4.3
• 作者: Weite Zhang;J. Martinez-Lorenzo

Sensing Matrix Design via Mutual Coherence Minimization for Electromagnetic Compressive Imaging Applications

• DOI: 10.1109/tci.2017.2671398
• 发表时间: 2017-02
• 期刊: IEEE Transactions on Computational Imaging
• 影响因子: 5.4
• 作者: R. Obermeier;J. Lorenzo

A Low Cost Reflect Array for Near-field Millimeter-Wave Beam Focusing Applications

用于近场毫米波光束聚焦应用的低成本反射阵列

• DOI: 10.1109/apusncursinrsm.2018.8609004
• 发表时间: 2018
• 期刊: 2018 IEEE International Symposium on Antennas and Propagation & USNC/URSI National Radio Science Meeting
• 作者: Molaei, Ali;Martinez-Lorenzo, Jose
• 通讯作者: Martinez-Lorenzo, Jose