CAREER: Learning Probabilistic Factor Models

职业：学习概率因子模型

• 批准号: 1943902
• 负责人: Zheng Ke
• 金额: $ 40万
• 依托单位: Harvard University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-07-01 至 2025-06-30
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1943902&HistoricalAwards=false
• 关键词: CAREER; Learning; Probabilistic; Factor; Models

A large amount of text and social network data is emerging in scientific research as well as everyday life. This project will develop statistical methods for analyzing data resulting in new scientific, sociological, and biomedical discoveries. The research has several fundamental challenges due to the features of the data: (1) large scale, which requires advanced strategies on storage, computation, and quality control; (2) a complicated structure, which makes careful statistical modeling a critical need; and (3) strong noise, which requires sophisticated de-noising techniques. To address these challenges, the PI proposes a universal probabilistic factor modeling approach. The research will provide an array of statistical tools for social network analysis, natural language processing, RNA-sequencing data analysis, and electronic health records analysis. This project will also help train graduate and undergraduate students on data collection, data cleaning, statistical methodology and theory. In addition, this project will release new software and data sets for network and text analysis providing useful resources for both education and research. Probabilistic factor models refer to factor models whose factors or factor loadings are connected to probability mass functions. Examples include the topic models in text mining and mixed membership models in social networks. Due to the nonnegative constraints and the dependent and heteroscedastic noise in these models, statistical estimation and inference are extremely challenging. This project will tackle these challenges and apply the proposed methods to different applications. The first thrust aims to develop a novel framework for exploring sparsity in topic models. It proposes a new notion of "sparsity" on the vocabulary, which is different from the conventional notion of sparsity in high-dimensional statistics. The framework will provide a theoretical foundation for dimension reduction in text mining, as well as new word screening methods and new spectral methods for topic weight estimation. The second thrust aims to study the fundamental statistical limits for network mixed membership estimation. It will lead to a new optimality theory of mixed membership estimation, especially for network models with a large degree of heterogeneity, and new random matrix theory for empirical eigenvectors. It will also produce data sets about the networks among academic researchers in statistics-related fields and generate discoveries about the trend and patterns in academic research. The third thrust aims to adapt the above technical tools to biomedical data, including bulk and single-cell RNA-sequencing data and electronic health care data. It will result in new mixture models and statistical inference tools for biomedical data.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

科学研究和日常生活中出现了大量文本和社交网络数据。该项目将开发用于分析数据的统计方法，从而产生新的科学，社会学和生物医学发现。由于数据的特点，该研究面临几个基本挑战：（1）大规模，需要先进的存储，计算和质量控制策略;（2）复杂的结构，这使得仔细的统计建模成为关键需求;（3）强噪声，需要复杂的去噪技术。为了应对这些挑战，PI提出了一种通用的概率因素建模方法。该研究将为社交网络分析、自然语言处理、RNA测序数据分析和电子健康记录分析提供一系列统计工具。 该项目还将帮助培训研究生和本科生数据收集，数据清理，统计方法和理论。此外，该项目还将发布用于网络和文本分析的新软件和数据集，为教育和研究提供有用的资源。 概率因子模型是指因子或因子载荷与概率质量函数相关联的因子模型。例子包括文本挖掘中的主题模型和社交网络中的混合成员模型。由于这些模型中的非负约束以及相关和异方差噪声，统计估计和推断极具挑战性。该项目将应对这些挑战，并将所提出的方法应用于不同的应用程序。第一个推力的目的是开发一个新的框架，探索稀疏的主题模型。在词汇表上提出了一个新的“稀疏性”概念，它不同于高维统计中的传统稀疏性概念。该框架将为文本挖掘中的降维提供理论基础，并为主题权重估计提供新词筛选方法和新的谱方法。第二个目标是研究网络混合隶属度估计的基本统计极限。它将导致一种新的混合隶属度估计的最优性理论，特别是对于具有很大程度异质性的网络模型，以及新的经验特征向量随机矩阵理论。它还将产生关于南极学相关领域学术研究人员网络的数据集，并发现学术研究的趋势和模式。第三个目标是使上述技术工具适用于生物医学数据，包括批量和单细胞RNA测序数据和电子医疗保健数据。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Improvements on SCORE, Especially for Weak Signals

SCORE 的改进，特别是对于弱信号

• DOI: 10.1007/s13171-020-00240-1
• 发表时间: 2021
• 期刊: Sankhya A
• 作者: Jin, Jiashun;Ke, Zheng Tracy;Luo, Shengming
• 通讯作者: Luo, Shengming

Phase transition for detecting a small community in a large network

用于检测大型网络中的小社区的相变

• 发表时间: 2023
• 期刊: The Eleventh International Conference on Learning and Representations
• 作者: Jin, Jiashun;Ke, Zheng Tracy;Turner, Paxton;Zhang, Anru
• 通讯作者: Zhang, Anru

Optimal adaptivity of signed-polygon statistics for network testing

• DOI: 10.1214/21-aos2089
• 发表时间: 2019-04
• 期刊: The Annals of Statistics
• 作者: Jiashun Jin;Z. Ke;Shengming Luo

A Comparison of Hamming Errors of Representative Variable Selection Methods

代表性变量选择方法的汉明误差比较

• 发表时间: 2022
• 期刊: ICLR 2022
• 作者: Ke, Zheng Tracy;Wang, Longlin
• 通讯作者: Wang, Longlin

Allocation of COVID‐19 testing budget on a commute network of counties

在县通勤网络上分配 COVID-19 检测预算

• DOI: 10.1002/sta4.441
• 发表时间: 2022
• 期刊: Stat
• 影响因子: 1.7
• 作者: Huang, Yaxuan;Ke, Zheng Tracy;Jin, Jiashun
• 通讯作者: Jin, Jiashun