Mathematical Analysis of Super-Resolution via Nonconvex Optimization and Machine Learning

通过非凸优化和机器学习进行超分辨率数学分析

• 批准号: 2009752
• 负责人: Carlos Fernandez Granda
• 金额: $ 34万
• 依托单位: New York University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-08-01 至 2024-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2009752&HistoricalAwards=false
• 关键词: Mathematical; Analysis; Super; Resolution; via

Diffraction imposes a fundamental limit on the resolution of optical systems. Consequently, in fields such as microscopy, astronomy, and medical imaging, it is often challenging to discern cellular structures, far-away stars, or tumours from the available measurements. The issue also arises in electronic imaging, where shot noise constrains the minimum pixel size, and in other applications, including signal processing, spectroscopy, radar, and seismology. The goal of super-resolution is to meet this challenge, uncovering fine-scale structure from coarse-scale data. In this project the investigators will analyze super-resolution techniques, design new methodology based on the resulting insights, and apply the methodology to fluorescence microscopy, which has become an essential imaging tool in biology. The proposed integrated program of educational and research activities will impact workforce development by training students at the intersection of data science, signal processing, and machine learning. This will contribute to address the rising demand for data scientists and engineers in industry and academia.Modern super-resolution techniques based on nonconvex optimization provide model flexibility, computational efficiency, and yield good empirical results. However, theoretical analysis showing under what conditions these techniques are guaranteed to work, or may fail, is lacking. In addition, recent works show that learning-based methods based on neural networks can be trained to perform super-resolution effectively and efficiently. Calibrating these models requires minimizing a highly nonconvex cost function. The proposed research activities will advance the theoretical underpinnings of nonconvex optimization for super-resolution and related problems such as line-spectra estimation and blind deconvolution. The project will focus on the super-resolution of point sources, which may represent fluorescent particles in microscopy, astral bodies in astronomy, spectral lines in signal processing, or neuron action potentials in neuroscience. The investigators will perform a mathematical analysis of the geometric landscapes that arise when using nonconvex cost functions to fit point sources, and also study the properties of learning-based approaches when deployed on point-source signal models. To complement their theoretical investigations, they will apply these techniques to real fluorescence-microscopy data.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

衍射对光学系统的分辨率施加了基本的限制。因此，在显微镜、天文学和医学成像等领域，从现有的测量结果中辨别细胞结构、遥远的恒星或肿瘤通常是具有挑战性的。这个问题也出现在电子成像中，其中散粒噪声限制了最小像素尺寸，以及其他应用，包括信号处理，光谱学，雷达和地震学。超分辨率的目标就是应对这一挑战，从粗尺度数据中揭示细尺度结构。在这个项目中，研究人员将分析超分辨率技术，根据所得的见解设计新的方法，并将该方法应用于荧光显微镜，这已成为生物学中必不可少的成像工具。拟议的教育和研究活动综合计划将通过在数据科学，信号处理和机器学习的交叉点培训学生来影响劳动力发展。这将有助于满足工业界和学术界对数据科学家和工程师不断增长的需求。基于非凸优化的现代超分辨率技术提供了模型灵活性、计算效率，并产生了良好的经验结果。然而，理论分析表明，在什么条件下，这些技术是保证工作，或可能失败，是缺乏的。此外，最近的工作表明，基于神经网络的学习方法可以被训练成有效和高效地执行超分辨率。校准这些模型需要最小化一个高度非凸的成本函数。这些研究工作将为超分辨率非凸优化及相关问题如线性谱估计和盲反卷积提供理论基础。该项目将专注于点源的超分辨率，这可能代表显微镜中的荧光粒子，天文学中的星体，信号处理中的光谱线或神经科学中的神经元动作电位。研究人员将对使用非凸成本函数拟合点源时出现的几何景观进行数学分析，并研究基于学习的方法在点源信号模型上部署时的特性。为了补充他们的理论研究，他们将把这些技术应用到真实的荧光显微镜数据中。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为是值得支持的。

项目成果

Adaptive Early-Learning Correction for Segmentation from Noisy Annotations

• DOI: 10.1109/cvpr52688.2022.00263
• 发表时间: 2021-10
• 期刊: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
• 作者: Sheng Liu;Kangning Liu;Weicheng Zhu;Yiqiu Shen;C. Fernandez‐Granda

Avoiding spurious correlations via logit correction

• DOI: 10.48550/arxiv.2212.01433
• 发表时间: 2022-12
• 期刊: ArXiv
• 作者: Sheng Liu;Xu Zhang-;Nitesh Sekhar;Yue Wu;Prateek Singhal;C. Fernandez‐Granda

Adaptive Test Allocation for Outbreak Detection and Tracking in Social Contact Networks

用于社交联系网络中爆发检测和跟踪的自适应测试分配

• DOI: 10.1137/20m1377874
• 发表时间: 2022
• 期刊: SIAM Journal on Control and Optimization
• 影响因子: 2.2
• 作者: Batlle, Pau;Bruna, Joan;Fernandez-Granda, Carlos;Preciado, Victor M.
• 通讯作者: Preciado, Victor M.

Convolutional Normalization: Improving Deep Convolutional Network Robustness and Training

• 发表时间: 2021-03
• 作者: Sheng Liu;Xiao Li;Yuexiang Zhai;Chong You;Zhihui Zhu;C. Fernandez‐Granda;Qing Qu

Benchmarking of Machine Learning Ocean Subgrid Parameterizations in an Idealized Model

• DOI: 10.1029/2022ms003258
• 发表时间: 2022-12
• 期刊: Journal of Advances in Modeling Earth Systems
• 影响因子: 6.8
• 作者: Andrew Ross;Ziwei Li;P. Perezhogin;C. Fernandez‐Granda;L. Zanna