Hidden Components in Modern Applications

现代应用中的隐藏组件

• 批准号: 1925845
• 负责人: Zheng Ke
• 金额: $ 14.18万
• 依托单位: Harvard University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-07-01 至 2020-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1925845&HistoricalAwards=false
• 关键词: Hidden; Components; Modern; Applications

In the era of Big Data, researchers often encounter datasets that are large in size and complex in structure where the information of interest is usually contained in "components" hidden in the enormous amount of noise. Examples include communities in large social networks, topics in text documents, and confounding factors in genome-wide association studies (GWAS). Extracting these hidden components is an interesting but challenging problem. This project will address these challenges and include applications to many scientific areas including social networks, text mining, genomics, and genetics. The project will include (a) collection of large social networks data, (b) development of new models, methods, and theory for extracting hidden components in network analysis, text mining, and genome-wide association studies, and (c) a study of knowledge discovery using academic research data such as co-authorship and citation relationships. The research will have an impact in linguistics, social sciences, cancer research, and knowledge discovery. This project aims to develop statistical models, methods, and theory for inferring and utilizing hidden components in complex data, especially matrix data. The goals of the project include: (1) Development of simple and fast methods for network mixed membership estimation and topic model estimation. These methods, based on nontrivial modifications of Principal Component Analysis (PCA), are easy to implement and can handle very large data. (2) New methods and theory for detecting and estimating rare and weak effects in GWAS. Problems related to optimal ranking of genes in the presence of complex correlation structures and detection of weak spikes in large covariance matrices will be considered. (3) A study of social network structures of scientific researchers. The PI and her collaborators will collect meta-information from published articles in representative statistics journals to understand social network structures and other features of the statistics community. (4) Development of new random matrix theory (RMT) for statistical analysis.

在大数据时代，研究人员经常遇到体量庞大、结构复杂的数据集，其中感兴趣的信息通常包含在隐藏在巨大噪音中的“组件”中。例子包括大型社交网络中的社区、文本文档中的主题以及全基因组关联研究中的混杂因素。提取这些隐藏的组件是一个有趣但具有挑战性的问题。该项目将解决这些挑战，并包括在许多科学领域的应用，包括社交网络、文本挖掘、基因组学和遗传学。该项目将包括(A)收集大型社交网络数据，(B)开发在网络分析、文本挖掘和全基因组关联研究中提取隐藏成分的新模型、方法和理论，以及(C)利用合著性和引文关系等学术研究数据进行知识发现研究。这项研究将对语言学、社会科学、癌症研究和知识发现产生影响。该项目旨在开发统计模型、方法和理论，用于推断和利用复杂数据中的隐藏成分，特别是矩阵数据。该项目的目标包括：(1)开发简单快速的网络混合成员估计和主题模型估计方法。这些方法基于主成分分析(PCA)的非平凡修改，易于实现，可以处理非常大的数据。(2)新方法和新理论，用于检测和评估GWAS中的稀有和微弱效应。将考虑在存在复杂相关结构的情况下对基因进行最优排序以及在大协方差矩阵中检测弱尖峰的问题。(3)科研人员的社会网络结构研究。PI和她的合作者将从有代表性的统计期刊上发表的文章中收集元信息，以了解统计社区的社会网络结构和其他特征。(4)发展用于统计分析的新随机矩阵理论(RMT)。

项目成果

Improvements on SCORE, Especially for Weak Signals

SCORE 的改进，特别是对于弱信号

• DOI: 10.1007/s13171-020-00240-1
• 发表时间: 2021
• 期刊: Sankhya A
• 作者: Jin, Jiashun;Ke, Zheng Tracy;Luo, Shengming
• 通讯作者: Luo, Shengming

State Aggregation Learning from Markov Transition Data

• 发表时间: 2018-11
• 期刊: ArXiv
• 作者: Yaqi Duan;Z. Ke;Mengdi Wang

Network global testing by counting graphlets

通过计算 graphlet 进行网络全局测试

• 发表时间: 2018
• 期刊: Proceedings of Machine Learning Research
• 作者: Jin, Jiashun;Ke, Zheng Tracy;Luo, Shengming
• 通讯作者: Luo, Shengming

PHASE TRANSITIONS FOR HIGH DIMENSIONAL CLUSTERING AND RELATED PROBLEMS

• DOI: 10.1214/16-aos1522
• 发表时间: 2017-10-01
• 期刊: ANNALS OF STATISTICS
• 影响因子: 4.5
• 作者: Jin, Jiashun;Ke, Zheng Tracy;Wang, Wanjie
• 通讯作者: Wang, Wanjie

Racial disparities in kidney transplant waitlist appearance in Chicago: Is it race or place?

• DOI: 10.1111/ctr.13195
• 发表时间: 2018-05
• 期刊: Clinical transplantation
• 影响因子: 2.1
• 作者: Peng RB;Lee H;Ke ZT;Saunders MR
• 通讯作者: Saunders MR