CDS&E-MSS: Sparsely Activated Bayesian Neural Networks from Deep Gaussian Processes

这个数学和统计科学中的计算和数据支持的科学与工程（CDS E-MSS）项目旨在开发一种系统的方法来构建深度贝叶斯神经网络，这些网络既具有计算效率又适合模型设计。该项目的结果预计将导致在准确性，置信度和效率方面的显着改进，超过当前的机器学习和人工智能模型。在本项目期间，将开发开放源码软件，为研究人员和从业人员提供可利用的工具。这项研究预计将影响广泛的应用，包括自动驾驶汽车、医疗诊断以及贸易和金融。研究人员还致力于为少数民族和代表性不足的群体促进STEM教育和研究机会，该项目还为研究生提供研究培训机会。该研究预计将在几个关键领域推进深度高斯过程模型和相关贝叶斯神经网络，包括理论和算法开发，其在生成任务中的应用，以及软件开发和验证。该研发计划主要包括以下三个部分：1）更好地理解深度张量马尔可夫高斯过程模型的属性，并构建更广泛的模型类别，这些模型具有更复杂的架构，但仍然可以通过具有稀疏结构的深度贝叶斯神经网络来近似; 2）探索深度高斯过程模型的随机性，以创建新的条件生成模型;以及3）开发软件工具，并使用最先进的无线通信和计算机视觉系统的真实数据集验证项目成果。NSF数学科学部的这一奖项由土木，机械，该奖项反映了NSF的法定使命，并通过使用基金会的知识产权进行评估，优点和更广泛的影响审查标准。

This Computational and Data-Enabled Science and Engineering in Mathematical and Statistical Sciences (CDS&E-MSS) project aims to develop a systematic approach for constructing deep Bayesian neural networks that are both computationally efficient and amenable to model designs. The results of this project are expected to lead to significant improvements in terms of accuracy, confidence, and efficiency over the current machine learning and artificial intelligence models. Open-source software will be developed during the course of this project, providing accessible tools for researchers and practitioners. This study is expected to impact a wide range of applications including self-driving cars, medical diagnostics, and trading and finance. The investigators are also committed to promoting STEM education and research opportunities for minority and underrepresented groups, and this project also provides research training opportunities for graduate students. The research is expected to advance deep Gaussian process models and relevant Bayesian neural networks in several key areas, including theory and algorithmic development, their applications to generative tasks, and software development and validation. The research and development plan mainly consists of the following three components: 1) to better understand the properties of deep tensor Markov Gaussian process models and to construct a broader class of models that have more complex architectures but can still be approximated by deep Bayesian neural networks with sparse structure; 2) to explore the stochastic nature of deep Gaussian process models to create novel conditional generative models; and 3) to develop software tools and to validate the project outcomes using real-world datasets from the state-of-the-art wireless communication and computer vision systems.This award by the NSF Division of Mathematical Sciences is jointly supported by the Division of Civil, Mechanical, and Manufacturing Innovation.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.