Hidden Components in Modern Applications

在大数据时代，研究人员经常会遇到规模庞大且结构复杂的数据集，其中感兴趣的信息通常包含在隐藏在大量噪声中的“组件”中。 例子包括大型社交网络中的社区、文本文档中的主题以及全基因组关联研究（GWAS）中的混杂因素。 提取这些隐藏的组件是一个有趣但具有挑战性的问题。该项目将解决这些挑战，并包括应用到许多科学领域，包括社交网络，文本挖掘，基因组学和遗传学。该项目将包括（a）收集大型社交网络数据，（B）开发新的模型、方法和理论，用于提取网络分析、文本挖掘和全基因组关联研究中的隐藏组件，以及（c）利用学术研究数据（如合著和引用关系）进行知识发现研究。这项研究将对语言学、社会科学、癌症研究和知识发现产生影响。 该项目旨在开发用于推断和利用复杂数据（特别是矩阵数据）中隐藏成分的统计模型，方法和理论。 本计画的目标包括：（1）发展简单且快速的网路混合隶属度估测与主题模式估测方法。这些方法，基于主成分分析（PCA）的非平凡修改，易于实现，可以处理非常大的数据。(2)用于检测和估计GWAS中罕见和弱效应的新方法和理论。 在复杂的相关结构和检测大协方差矩阵中的弱尖峰的存在下，基因的最佳排名相关的问题将被考虑。(3)科研人员社会网络结构研究。 PI及其合作者将从代表性统计期刊上发表的文章中收集元信息，以了解统计社区的社交网络结构和其他功能。(4)发展新的随机矩阵理论（RMT）用于统计分析。

In the era of Big Data, researchers often encounter datasets that are large in size and complex in structure where the information of interest is usually contained in "components" hidden in the enormous amount of noise. Examples include communities in large social networks, topics in text documents, and confounding factors in genome-wide association studies (GWAS). Extracting these hidden components is an interesting but challenging problem. This project will address these challenges and include applications to many scientific areas including social networks, text mining, genomics, and genetics. The project will include (a) collection of large social networks data, (b) development of new models, methods, and theory for extracting hidden components in network analysis, text mining, and genome-wide association studies, and (c) a study of knowledge discovery using academic research data such as co-authorship and citation relationships. The research will have an impact in linguistics, social sciences, cancer research, and knowledge discovery. This project aims to develop statistical models, methods, and theory for inferring and utilizing hidden components in complex data, especially matrix data. The goals of the project include: (1) Development of simple and fast methods for network mixed membership estimation and topic model estimation. These methods, based on nontrivial modifications of Principal Component Analysis (PCA), are easy to implement and can handle very large data. (2) New methods and theory for detecting and estimating rare and weak effects in GWAS. Problems related to optimal ranking of genes in the presence of complex correlation structures and detection of weak spikes in large covariance matrices will be considered. (3) A study of social network structures of scientific researchers. The PI and her collaborators will collect meta-information from published articles in representative statistics journals to understand social network structures and other features of the statistics community. (4) Development of new random matrix theory (RMT) for statistical analysis.