Stochastic iterative regularization: theory, algorithms and applications

随机迭代正则化：理论、算法和应用

• 批准号: EP/T000864/1
• 负责人: Bangti Jin
• 金额: $ 49.09万
• 依托单位: University College London
• 依托单位国家: 英国
• 项目类别: Research Grant
• 财政年份: 2020
• 资助国家: 英国
• 起止时间: 2020 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=EP%2FT000864%2F1
• 关键词: Stochastic; iterative; regularization; theory; algorithms

An inverse problem arises whenever one seeks the cause of observed physical phenomena or observational data, e.g., inferring the governing law from the measurements. This task essentially underlies all scientific discoveries and technological innovations. Thus, the mathematical theory and computational techniques for solving inverse problems are central, e.g., in physics, astronomy, medicine, engineering, and life sciences, and it has evolved into a highly interdisciplinary research area. Inverse problems are usually ill-posed in the sense that the sought-for solution lacks existence, uniqueness or stability with respect to data perturbation. Since the noise is inherent in the observational data, the numerical algorithms have to employ specialized techniques, commonly known as regularization. The corresponding mathematical framework in the form of regularization theory is highly developed, since the pioneering works of A. Tikhonov in 1960s, H. Engl et al from 1980s and many other researchers. This theory has played a vital role in many research areas, and related numerical algorithms have also been intensively investigated. One versatile framework is to minimize an objective function measuring the quality of fitting between the model output and observational data, possibly plus some additional penalty term, and it covers a large class of powerful iterative inversion techniques.Due to the unprecedented advances in data acquisition technologies, large datasets are becoming common place for many practical inverse problems. Prominent examples in medical imaging include dynamic, multispectral, multi-energy or multi-frequency data in computed tomography and optical tomography. The ever increasing volume of available data poses enormous computational challenges to image reconstruction, and traditional iterative methods can be too expensive to apply, and currently it represents one of the bottlenecks to extract useful information from the massive dataset. This is especially challenging for problems involving complex physical models, where each data set is very expensive to simulate.The proposed research aims at addressing the aforementioned outstanding computational challenge using stochastic iterative techniques developed within the machine learning community, and providing relevant theoretical underpinnings. The central idea of stochastic iterative methods is that at each step only a (small) portion of the data set is used to steer the progression of the iterates, instead of the full data set. This allows drastically reducing the computational cost per iteration. This idea has received enormous attention within the machine learning community, and especially has achieved stunning success in deep learning in recent years. Actually stochastic gradient descent and its variants are the workhorse behind many deep learning tasks. A successful completion of this project will greatly advance modern image reconstruction by providing a systematic mathematical and computational framework, including comprehensive theoretical underpinnings, novel algorithms and detailed studies on concrete inverse problems, e.g., in medical imaging.

每当人们寻求观测到的物理现象或观测数据的原因时，就会出现反问题，例如，从测量中推断支配规律。这项任务是所有科学发现和技术创新的根本。因此，求解逆问题的数学理论和计算技术在物理学、天文学、医学、工程和生命科学等领域都是核心，并已发展成为一个高度跨学科的研究领域。逆问题通常是病态的，即所求解在数据扰动下缺乏存在性、唯一性或稳定性。由于噪声是观测数据中固有的，数值算法必须采用专门的技术，通常称为正则化。自20世纪60年代A. Tikhonov、80年代H. Engl等许多研究者的开创性工作以来，相应的正则化理论形式的数学框架得到了高度发展。该理论在许多研究领域起着至关重要的作用，相关的数值算法也得到了深入的研究。一个通用的框架是最小化衡量模型输出和观测数据之间拟合质量的目标函数，可能加上一些额外的惩罚项，它涵盖了一大类强大的迭代反演技术。由于数据采集技术的空前进步，大型数据集正在成为许多实际反问题的常见场所。医学成像的突出例子包括计算机断层扫描和光学断层扫描中的动态、多光谱、多能或多频率数据。不断增加的可用数据量给图像重建带来了巨大的计算挑战，传统的迭代方法成本过高，难以应用，从海量数据集中提取有用信息是目前的瓶颈之一。这对于涉及复杂物理模型的问题尤其具有挑战性，因为每个数据集的模拟都非常昂贵。提出的研究旨在利用机器学习社区开发的随机迭代技术解决上述突出的计算挑战，并提供相关的理论基础。随机迭代方法的核心思想是，在每一步中，只使用数据集的一小部分来引导迭代的进程，而不是使用整个数据集。这可以大大减少每次迭代的计算成本。这个想法在机器学习社区受到了极大的关注，特别是近年来在深度学习领域取得了惊人的成功。实际上，随机梯度下降及其变体是许多深度学习任务背后的主力。该项目的成功完成将通过提供系统的数学和计算框架，包括全面的理论基础，新颖的算法和对具体逆问题（例如医学成像）的详细研究，极大地推进现代图像重建。

项目成果

Score-Based Generative Models for PET Image Reconstruction

• DOI: 10.59275/j.melba.2024-5d51
• 发表时间: 2023-08
• 期刊: ArXiv
• 作者: I. Singh;Alexander Denker;Riccardo Barbano;vZeljko Kereta;Bangti Jin;K. Thielemans;P. Maass;S. Arridge

Material Decomposition in Spectral CT Using Deep Learning: A Sim2Real Transfer Approach

• DOI: 10.1109/access.2021.3056150
• 发表时间: 2021-01-01
• 期刊: IEEE ACCESS
• 影响因子: 3.9
• 作者: Abascal, Juan F. P. J.;Ducros, Nicolas;Peyrin, Francoise
• 通讯作者: Peyrin, Francoise

Hybrid neural-network FEM approximation of diffusion coefficient in elliptic and parabolic Problems

椭圆和抛物线问题中扩散系数的混合神经网络 FEM 近似

• DOI: 10.1093/imanum/drad073
• 发表时间: 2023
• 期刊: IMA Journal of Numerical Analysis
• 影响因子: 2.1
• 作者: Cen S

Recovery of multiple parameters in subdiffusion from one lateral boundary measurement

• DOI: 10.1088/1361-6420/acef50
• 发表时间: 2023-07
• 期刊: Inverse Problems
• 影响因子: 2.1
• 作者: Siyu Cen;Bangti Jin;Yikan Liu;Zhi Zhou

Steerable Conditional Diffusion for Out-of-Distribution Adaptation in Imaging Inverse Problems

• DOI: 10.48550/arxiv.2308.14409
• 发表时间: 2023-08
• 期刊: ArXiv
• 作者: Riccardo Barbano;Alexander Denker;Hyungjin Chung;Tae Hoon Roh;Simon Arrdige;P. Maass;Bangti Jin;J. C. Ye