Sparsity Regularization for Inverse Problems -- Theory, Algorithm and Application

许多科学和工程学科的一项基本任务是探索我们周围的世界，通常是以推断物理定律或根据实验数据确定其中参数的形式。这引起了各种各样的逆问题，如推断观察到的物理现象的原因或根据测量的响应确定有关对象的介质性质。基于模型的反问题方法以线性或非线性方程的形式假定未知物理量与测量响应之间的已知关系。逆问题在数值上具有挑战性，因为它们相对于数据噪声是不稳定的。最成功和最有效的技术之一是通过正则化的方法结合先验知识。本课题主要研究一种基于稀疏性约束的正则化方法，在稀疏性正则化方法中，人们寻找一种具有尽可能少的非零项(或小支持度)的近似解。也就是说，我们的目标是通过简单地使用少量的参数来解释物理现象。在这个项目中，我们研究了该方法的数学理论、计算技术和实际应用，特别是通过对所求解使用非凸罚的方法。文献中提出了几种非凸罚，特别是在统计学和机器学习中，我们将考虑流行的L0罚、桥罚、光滑截断绝对偏差、最小最大凹罚和截断的L1罚。尽管它们很受欢迎，但它们在逆问题中的应用和研究仍然非常有限。建议的项目在反问题理论的框架内检查这些技术。具体地说，我们在项目期间专注于以下目标：(A)开发一种用于高效求解正则化模型(带有非凸罚)的原始-对偶有效集型计算方法，并严格建立算法的收敛；(B)开发适用的正则化参数的选择规则，并分析“局部”最小化器的结构特性；(3)将非凸法与自适应有限元方法相结合，应用于层析成像。待开发的计算技术-原始对偶活动集算法广泛适用于许多其他领域，特别是机器学习和统计，因为这些非凸模型在那里有它们的起源和动机。在数学上，稀疏正则化理论将为非光滑正则化的分析提供有价值的启示，非光滑正则化与成像和信号处理中的许多重要数学模型具有共同的结构。具体的正则化参数选择规则将使参数的自动选择具有严格的理论依据，并在繁琐的试错基础上提高当前实践的效率。层析成像的研究，即非凸罚函数和自适应算法的应用，将直接影响到医学影像学界。有一大批研究人员致力于断层成像，这将直接受益于这项研究，并将不断向他们展示所获得的研究成果。更广泛地说，它为开发求解非线性微分方程逆问题的有效算法提供了指导。综上所述，该项目将把反问题的稀疏正则化提高到一个新的水平。

One fundamental task in many scientific and engineering disciplines is to probe the world around us, often in the form of deducing physical laws or determining the parameters therein from experimental data. This gives rise to a wide variety of inverse problems of inferring the cause of observed physical phenomena or determining medium properties of the concerned object from the measured responses. A model based approach to inverse problems assumes a known relation between the unknown physical quantity and the measured responses, in the form of linear or nonlinear equations. Inverse problems are numerically challenging to solve since they are unstable with respect to data noise. One of the most successful and powerful techniques is to incorporate a priori knowledge by means of regularization. This project focuses on one specific regularization technique based on sparsity constraints.In sparsity regularization, one looks for an approximate solution that has as few nonzero entries (or a small support) as possible. That is, we aim at explaining the physical phenomenon by simply using a small number of parameters. In this project, we study the mathematical theory, computational techniques and practical applications of the approach, especially by using a nonconvex penalty on the sought-for solution. There are several nonconvex penalties proposed in the literature, especially in statistics and machine learning, and we shall consider, for example, the popular l0 penalty, bridge penalty, smoothly clipped absolute deviation, minmax concavity penalty and clipped l1 penalties. Despite their popularity, their use and study in the context of inverse problems remain very limited. The proposed project examines these techniques in the framework of inverse problems theory. Specifically, we focus on the following objectives during the project period: (a) to develop a computational method of primal-dual active set type for efficiently solving the regularized model (with nonconvex penalties) and rigorously establish the convergence of the algorithm; (b) to develop applicable choice rules for the regularization parameter, and to analyze the structural properties of "local" minimizers; (3) to apply the nonconvex approach to tomography imaging, by combining it with an adaptive finite element method. The computational technique to be developed, primal dual active set algorithm, is widely applicable to many other areas, especially machine learning and statistics, since these nonconvex models have their origins and motivations there. Mathematically, the theory of sparsity regularization will shed valuable lights into the analysis of nonsmooth regularization, which shares common structures with many important mathematical models arising in imaging and signal processing. The specific choice rule for the regularization parameter will enable automatic parameter selection yet with rigorous theoretical justification, and improve the efficiency of the current practice based on tedious trial and error. The research in tomography imaging, i.e., the application of nonconvex penalty and adaptive algorithm, will directly impact the medical imaging community. There are a large group of researchers working on tomography imaging that will benefit directly from the research, and the obtained research results will be presented to them continuously. More generally, it provides guidance for developing efficient algorithms for nonlinear inverse problems for differential equations. In summary, the project will take sparsity regularization for inverse problems to the next level.