BIGDATA: F: Learning Big Bayesian Networks

BIGDATA：F：学习大贝叶斯网络

• 批准号: 1546098
• 负责人: Qing Zhou
• 金额: $ 91.93万
• 依托单位: University of California-Los Angeles
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-10-01 至 2020-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1546098&HistoricalAwards=false
• 关键词: BIGDATA; Learning; Big; Bayesian; Networks

A fundamental problem in analyzing big data is to extract and represent the relations among the huge number of variables in a dataset. For example, in a genomic dataset, one may want to find out the dependence among a large number of genetic variations and various disease states. The Bayesian network is a commonly used class of mathematical models to represent such complex relations among a collection of variables, with wide applications in many scientific fields, ranging from the biomedical sciences to the social sciences. The goal of this project is to develop statistical and machine learning methods to construct Bayesian networks from big data, where the datasets may contain thousands to millions of variables. This is a challenging problem, particularly for large networks, as seen from the fact that state-of-the-art methods can barely handle thousands of variables. In this project, a novel divide-and-conquer approach will be developed and implemented as open-source packages for public use. The PIs will also study the theoretical properties of key components of this approach. Through seminar organization and educational activities in both graduate and undergraduate training, the cutting-edge research in this project will be communicated immediately to a much broader audience.The proposed approach consists of three main components: Partition, Estimation and Fusion (PEF). In the partition stage, spectral clustering will be embedded into an iterative subsampling approach to efficiently group variables into clusters. In the estimation stage, a few new methods will be developed to estimate the structure of a Bayesian network for each cluster of nodes, which serves as a subgraph of the big network. These methods include convex relaxations for permutations, fast algorithms for large-scale regularized estimation of the parameters of a Bayesian network, and novel formulations for discrete data. The final fusion stage will merge subgraphs into one big Bayesian network via a new method based on multiple-response sparse regression. Rigorous analysis of the PEF learning strategy for Bayesian networks under high-dimensional scaling will be conducted to provide theoretical guarantees for the methods and the algorithms.

分析大数据的一个基本问题是提取和表示数据集中大量变量之间的关系。例如，在基因组数据集中，人们可能想要找出大量遗传变异和各种疾病状态之间的依赖性。贝叶斯网络是一种常用的数学模型，用于表示变量集合之间的复杂关系，在许多科学领域中具有广泛的应用，从生物医学科学到社会科学。该项目的目标是开发统计和机器学习方法，从大数据中构建贝叶斯网络，其中数据集可能包含数千到数百万个变量。这是一个具有挑战性的问题，特别是对于大型网络，因为最先进的方法几乎无法处理数千个变量。在这个项目中，将开发一种新的分而治之的方法，并将其作为开放源码软件包供公众使用。PI还将研究这种方法的关键组成部分的理论特性。 通过研究生和本科生培训中的研讨会组织和教育活动，该项目的前沿研究将立即传达给更广泛的受众。该方法包括三个主要部分：划分，估计和融合（PEF）。在划分阶段，谱聚类将嵌入到迭代子采样方法中，以有效地将变量分组到聚类中。在估计阶段，将开发一些新的方法来估计贝叶斯网络的每个节点簇的结构，这些节点簇作为大网络的子图。这些方法包括置换的凸松弛，贝叶斯网络参数的大规模正则化估计的快速算法，以及离散数据的新配方。最后的融合阶段将通过一种基于多响应稀疏回归的新方法将子图合并成一个大的贝叶斯网络。对高维尺度下贝叶斯网络的PEF学习策略进行了严格的分析，为方法和算法提供了理论保证。