CAREER: Advances in Multi-scale Bayesian Inference and Learning on Massive Data

职业：多尺度贝叶斯推理和海量数据学习的进展

• 批准号: 1749789
• 负责人: Li Ma
• 金额: $ 40万
• 依托单位: Duke University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-09-01 至 2024-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1749789&HistoricalAwards=false
• 关键词: CAREER; Advances; Multi; scale; Bayesian

Massive data present unprecedented opportunities for advancing our understanding of various scientific and social phenomena. With sufficient data and the appropriate statistical tools, researchers can now hope to recover structures in the data that were once deemed too intricate to identify with traditional "small" data. Extracting complex hidden structures in massive data often requires flexible nonparametric methods; however, there are several fundamental challenges that make existing nonparametric methods impractical or inadequate. At the core of these challenges is a conflict between two essential aspects in big data analysis: (i) the need for flexible methodology for capturing complex features and (ii) the cost, both computational and statistical, associated with this additional flexibility. Effective resolution of this fundamental conflict requires new paradigms of nonparametric inference. The long-term research objective of this project is to develop inference paradigms, including theory, methods, algorithms, and software, for nonparametric inference and learning that effectively resolve this fundamental conflict. The research will lead to the development of statistical tools that meet urgent needs for scalable nonparametric data analysis in a wide range of fields, including biology, economics, astrophysics, chemistry, and information technology. The project will address the integration of research with educational activities through teaching and mentoring of undergraduate and graduate students, and outreach to students from local colleges.This project will develop and investigate a particularly promising paradigm, multi-scale divide-and-conquer, to address the fundamental conflict between flexibility and cost. Specific inference problems to be addressed cover a wide range of nonparametric inference and learning objectives, and can be organized into three research thrusts: (i) joint nonparametric modeling of multiple data generative processes; (ii) characterizing dependency between random variables/vectors; and (iii) response-domain ensemble supervised learning. Beyond addressing these specific objectives, the proposed research will introduce theoretical and computational devices for evaluating and improving the statistical and computational efficiency of multi-scale divide-and-conquer methods in general. The output of the research will include practical methods and algorithms for carrying out a variety of important nonparametric inference tasks on massive data, as well as general guiding principles for effective multi-scale statistical analysis. The research output will be disseminated through publications, presentations, and open-source software to the scientific community, and society at large.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

海量数据为增进我们对各种科学和社会现象的理解提供了前所未有的机会。有了足够的数据和适当的统计工具，研究人员现在可以希望恢复数据中的结构，这些结构曾经被认为过于复杂，无法用传统的“小”数据来识别。从海量数据中提取复杂的隐藏结构往往需要灵活的非参数方法；然而，有几个基本的挑战，使现有的非参数方法不切实际或不充分。这些挑战的核心是大数据分析中两个基本方面之间的冲突：(i)需要灵活的方法来捕获复杂的特征；（ii）与这种额外的灵活性相关的计算和统计成本。有效地解决这一基本冲突需要新的非参数推理范式。该项目的长期研究目标是开发推理范式，包括理论、方法、算法和软件，用于有效解决这一基本冲突的非参数推理和学习。这项研究将导致统计工具的发展，以满足广泛领域中可扩展的非参数数据分析的迫切需求，包括生物学、经济学、天体物理学、化学和信息技术。该项目将通过对本科生和研究生的教学和指导，以及与当地大学学生的联系，解决研究与教育活动的结合问题。该项目将开发和研究一个特别有前途的范例，多尺度分而治之，以解决灵活性和成本之间的根本冲突。要解决的具体推理问题涵盖了广泛的非参数推理和学习目标，并且可以组织成三个研究重点：(i)多个数据生成过程的联合非参数建模；（ii）描述随机变量/向量之间的依赖关系；（三）响应域集成监督学习。除了解决这些具体目标之外，拟议的研究将引入理论和计算设备，以评估和提高一般多尺度分治方法的统计和计算效率。研究成果将包括在海量数据上执行各种重要的非参数推理任务的实用方法和算法，以及有效的多尺度统计分析的一般指导原则。研究成果将通过出版物、演讲和开源软件向科学界和整个社会传播。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

CARP: Compression Through Adaptive Recursive Partitioning for Multi-Dimensional Images

CARP：通过多维图像的自适应递归分区进行压缩

• 发表时间: 2020
• 期刊: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR
• 作者: Liu, Rongjie;Li, Meng;Ma, Li
• 通讯作者: Ma, Li

A Bayesian hierarchical model for related densities by using Pólya trees

使用 Pólya 树计算相关密度的贝叶斯分层模型

• DOI: 10.1111/rssb.12346
• 发表时间: 2020
• 期刊: Journal of the Royal Statistical Society: Series B (Statistical Methodology
• 作者: Christensen, Jonathan;Ma, Li
• 通讯作者: Ma, Li

Learning Asymmetric and Local Features in Multi-Dimensional Data Through Wavelets With Recursive Partitioning

• DOI: 10.1109/tpami.2021.3110403
• 发表时间: 2017-11
• 期刊: IEEE Transactions on Pattern Analysis and Machine Intelligence
• 影响因子: 23.6
• 作者: Meng Li;Li Ma

Bayesian Graphical Compositional Regression for Microbiome Data

• DOI: 10.1080/01621459.2019.1647212
• 发表时间: 2019-08-26
• 期刊: JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION
• 影响因子: 3.7
• 作者: Mao, Jialiang;Chen, Yuhan;Ma, Li
• 通讯作者: Ma, Li