Developments in Gaussian Processes and Beyond: Applications in Geostatistics and Deep Learning

高斯过程及其他过程的发展：地统计学和深度学习中的应用

• 批准号: 2014371
• 负责人: Anindya Bhadra
• 金额: $ 12万
• 依托单位: Purdue University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-08-01 至 2023-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2014371&HistoricalAwards=false
• 关键词: Developments; Gaussian; Processes; Beyond; Applications

Gaussian processes have diverse applications in statistics and machine learning and are of great contemporary interest. To give a few examples, they arise in the modeling of spatial data, computer experiments, and in studying the limits of deep neural networks. Key reasons for the appeal of Gaussian processes include their simplicity and wide tractability: the entire process is characterized by just the mean and the covariance functions. Yet, although Gaussian processes are popular with well-developed theoretical and computational properties, there are some distinct limitations in using them. Moreover, there are several situations where Gaussian processes are inappropriate as a modeling choice. New methodology will be developed to address some of these limitations, with wide-ranging implications from spatial statistics to deep learning. Publicly available software development, student mentoring, and broad dissemination of research will have impacts beyond the particular research problems at hand.Key areas of the technical investigation are as follows. The first issue concerns the use of the ubiquitous Matern covariance function. A key benefit of the Matern family is the precise control over the smoothness of the resultant Gaussian processes (GP) realizations. However, the tails of the Matern covariance decay exponentially fast, which is inappropriate in the presence of polynomial dependence. Polynomial covariances such as Cauchy remedy this issue, but at the expense of a loss of control over smoothness, in that, GP realizations using Cauchy covariances are either infinitely differentiable or not at all. The PI will develop a new covariance function that combines the flexibility of the Matern and polynomial covariances. Next, the PI will study the limiting behavior of deep neural networks under global-local horseshoe regularization priors on the weights. The lack of bounded moments necessitates the construction of a new Levy process that can be used to study the limits of neural networks under such priors, thereby aiding uncertainty quantification. The PI will study the theoretical and computational properties of the resultant process. Finally, the PI will use recently developed global-local shrinkage approaches for Bayesian regularization in GP regression, with distinct improvements upon existing methods.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

高斯过程在统计学和机器学习中有着广泛的应用，并且在当代引起了极大的兴趣。举几个例子，它们出现在空间数据建模，计算机实验和研究深度神经网络的限制中。高斯过程吸引人的主要原因包括它们的简单性和广泛的易处理性：整个过程的特征在于仅仅是均值和协方差函数。然而，尽管高斯过程具有良好的理论和计算特性，但在使用它们时存在一些明显的限制。此外，有几种情况下，高斯过程不适合作为建模选择。将开发新的方法来解决其中的一些限制，从空间统计到深度学习都有广泛的影响。公开可用的软件开发、学生指导和研究的广泛传播将产生超出手头特定研究问题的影响。技术调查的关键领域如下。第一个问题涉及无处不在的Matern协方差函数的使用。Matern系列的一个主要优点是对高斯过程（GP）实现的平滑度进行精确控制。然而，Matern协方差的尾部呈指数快速衰减，这在多项式依赖的情况下是不合适的。多项式协方差（如柯西）解决了这个问题，但代价是失去了对平滑性的控制，因为使用柯西协方差的GP实现要么是无限可微的，要么根本不是。PI将开发一个新的协方差函数，结合Matern和多项式协方差的灵活性。接下来，PI将研究深度神经网络在全局-局部马蹄正则化先验权重下的限制行为。有界矩的缺乏需要一个新的Levy过程的建设，可用于研究这种先验下的神经网络的限制，从而帮助不确定性量化。PI将研究合成过程的理论和计算特性。最后，PI将使用最近开发的全局-局部收缩方法进行GP回归中的贝叶斯正则化，对现有方法进行了明显改进。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

A Laplace Mixture Representation of the Horseshoe and Some Implications

马蹄形的拉普拉斯混合表示及其一些含义

• DOI: 10.1109/lsp.2022.3228491
• 发表时间: 2022
• 期刊: IEEE Signal Processing Letters
• 影响因子: 3.9
• 作者: Sagar, Ksheera;Bhadra, Anindya
• 通讯作者: Bhadra, Anindya

Joint mean–covariance estimation via the horseshoe

通过马蹄形进行联合均值协方差估计

• DOI: 10.1016/j.jmva.2020.104716
• 发表时间: 2021
• 期刊: Journal of Multivariate Analysis
• 影响因子: 1.6
• 作者: Li, Yunfan;Datta, Jyotishka;Craig, Bruce A.;Bhadra, Anindya
• 通讯作者: Bhadra, Anindya

SURE-tuned bridge regression

• DOI: 10.1007/s11222-023-10350-z
• 发表时间: 2024-02-01
• 期刊: STATISTICS AND COMPUTING
• 影响因子: 2.2
• 作者: Loria，Jorge;Bhadra，Anindya
• 通讯作者: Bhadra，Anindya

Beyond Matérn: On A Class of Interpretable Confluent Hypergeometric Covariance Functions

超越马特恩：关于一类可解释的汇合超几何协方差函数

• DOI: 10.1080/01621459.2022.2027775
• 发表时间: 2022
• 期刊: Journal of the American Statistical Association
• 影响因子: 3.7
• 作者: Ma, Pulong;Bhadra, Anindya
• 通讯作者: Bhadra, Anindya

Discussion to: Bayesian graphical models for modern biological applications by Y. Ni, V. Baladandayuthapani, M. Vannucci and F.C. Stingo

• DOI: 10.1007/s10260-021-00600-7
• 发表时间: 2021-11
• 期刊: Statistical Methods & Applications
• 影响因子: 1
• 作者: M. Schweinberger