Iteratively Regularized Broyden-Type Algorithms for Nonlinear Inverse Problems

非线性反问题的迭代正则布罗伊登型算法

• 批准号: 1818886
• 负责人: Alexandra Smirnova
• 金额: $ 10万
• 依托单位: Georgia State University Research Foundation, Inc.
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-09-01 至 2021-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1818886&HistoricalAwards=false
• 关键词: Iteratively; Regularized; Broyden; Type; Algorithms

The goal of this project is to tackle major computational challenges faced by scientists and engineers in their quest to improve the accuracy and efficiency of numerical algorithms for solving large-scale inverse problems. This is a scenario where direct measurements of the unknown quantities are not feasible, and one needs to identify "cause from effect" by using (generally nonlinear) mathematical and statistical models. The resulting problems are notoriously ill-posed (or unstable), in a sense that even small measurement errors in the input data may give rise to a substantial noise propagation in the recovered solution, to the extent that this solution gets entirely destroyed. For this reason, special techniques called "regularization" must be combined with high-speed optimization procedures, so that reliable information on the unknown effect could be obtained from the available data. The key areas of application include imaging and sensing technology, machine learning, gravitational sounding, ocean acoustics, and data sciences.This project aims at the development of iteratively regularized Broyden-type numerical algorithms for solving nonlinear ill-posed inverse problems in either finite or infinite dimensional spaces. A family of new regularization methods will be designed to solve large-scale unstable least squares problems, where the Jacobian of a discretized nonlinear operator is difficult or even impossible to compute. To overcome this obstacle, PIs consider a family of Gauss-Newton and Levenberg-Marquardt algorithms with the Frechet derivative operator recalculated recursively by using Broyden-type single rank updates. To balance accuracy and stability, the pseudo-inverse for the derivative-free Jacobian is regularized in a problem-specific manner at every step of the iteration process. A variety of filters will be investigated, yielding greater flexibility in the use of qualitative and quantitative a priori information available for each particular applied problem. The proposed iteratively regularized methods will be studied in both deterministic and stochastic settings. For stochastic processes, the minimization functionals are evaluated subject to stochastic errors due to inexact computations to lower per-iteration cost, and/or unavoidable environmental noise and fluctuations. In the framework of the proposed research, PIs will conduct comprehensive convergence analysis of the new algorithms, including convergence rates and optimal policies for the selection of regularization parameters and step sizes. In addition to the theoretical investigation, a significant component of this project is to evaluate the proposed algorithms using extensive numerical experiments on real-world nonlinear inverse problems.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该项目的目标是解决科学家和工程师在寻求提高求解大规模逆问题的数值算法的精度和效率时所面临的主要计算挑战。在这种情况下，直接测量未知量是不可行的，需要通过使用（通常是非线性的）数学和统计模型来确定“因果关系”。由此产生的问题是众所周知的不适定（或不稳定），在某种意义上，即使是输入数据中的小测量误差也可能在恢复的解中引起大量的噪声传播，以至于该解被完全破坏。因此，称为“正则化”的特殊技术必须与高速优化程序相结合，以便从现有数据中获得关于未知效应的可靠信息。主要应用领域包括成像和传感技术、机器学习、重力探测、海洋声学和数据科学。该项目旨在开发迭代正则化Broyden型数值算法，用于解决有限维或无限维空间中的非线性不适定反问题。一类新的正则化方法将被设计来解决大规模不稳定最小二乘问题，其中离散非线性算子的雅可比矩阵很难甚至不可能计算。为了克服这一障碍，PI考虑一个家庭的高斯-牛顿和Levenberg-Marquardt算法与Frechet导数算子重新计算递归使用Broyden型单秩更新。为了平衡精度和稳定性，在迭代过程的每一步，以特定于问题的方式正则化无导数雅可比矩阵的伪逆。各种过滤器将进行调查，产生更大的灵活性，在使用定性和定量的先验信息可用于每个特定的应用问题。我们将在确定性和随机性两种环境下研究所提出的迭代正则化方法。对于随机过程，由于不精确的计算，以降低每次迭代的成本，和/或不可避免的环境噪声和波动的随机误差的最小化泛函进行评估。在拟议的研究框架内，PI将对新算法进行全面的收敛性分析，包括收敛速度和正则化参数和步长选择的最佳策略。除了理论研究之外，该项目的一个重要组成部分是使用真实世界非线性逆问题的广泛数值实验来评估所提出的算法。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

On Stable Parameter Estimation and Forecasting in Epidemiology by the Levenberg–Marquardt Algorithm with Broyden’s Rank-one Updates for the Jacobian Operator

• DOI: 10.1007/s11538-019-00650-9
• 发表时间: 2019-07
• 期刊: Bulletin of Mathematical Biology
• 影响因子: 3.5
• 作者: A. Smirnova;Benjamin Sirb;G. Chowell

Joint Edge Reconstruction in Multi-Contrast Medical Imaging

多对比医学成像中的联合边缘重建

• 发表时间: 2019
• 期刊: SIAM journal on imaging sciences
• 影响因子: 2.1
• 作者: Y. Chen, B. Li

Deep Parallel MRI Reconstruction Network Without Coil Sensitivities

• DOI: 10.1007/978-3-030-61598-7_2
• 发表时间: 2020-08
• 期刊: ArXiv
• 作者: Wanyu Bian;Yunmei Chen;X. Ye

Numerical solution of inverse problems by weak adversarial networks

• DOI: 10.1088/1361-6420/abb447
• 发表时间: 2020-02
• 期刊: Inverse Problems
• 影响因子: 2.1
• 作者: Gang Bao;X. Ye;Yaohua Zang;Haomin Zhou

Variational Model-Based Deep Neural Networks for Image Reconstruction

• DOI: 10.1007/978-3-030-03009-4_57-1
• 发表时间: 2021
• 期刊: Handbook of Mathematical Models and Algorithms in Computer Vision and Imaging
• 作者: Yunmei Chen;X. Ye;Qingchao Zhang