Collaborative Research: Statistical Inference for Functional and High Dimensional Data with New Dependence Metrics

协作研究：使用新的依赖性度量对功能和高维数据进行统计推断

• 批准号: 1607489
• 负责人: Xiaofeng Shao
• 金额: $ 18.5万
• 依托单位: University of Illinois at Urbana-Champaign
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-06-01 至 2020-05-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1607489&HistoricalAwards=false
• 关键词: Collaborative; Research; Statistical; Inference; Functional

Due to the rapid development of information technologies and their applications in many scientific fields such as climate science, medical imaging, and finance, statistical analysis of high-dimensional data and infinite-dimensional functional data has become increasingly important. A key challenge associated with the analysis of such big data is how to measure and infer complex dependence structure, which is a fundamental step in statistics and becomes more difficult owing to the data's high dimensionality and huge size. The main goal of this research project is to develop new dependence measures for quantifying dependence of large scale data sets such as temporally dependent functional data and high dimensional data, and utilize these new measures to develop novel statistical tools for conducting sparse principal component analysis, dimensional reduction, and simultaneous hypothesis testing. Building on the new dependence metrics that can capture nonlinear and non-monotonic dependence, the methodologies under development are expected to lead to more accurate prediction and inference, as well as more effective dimension reduction in the analysis of functional and high dimensional data. The research consists of three projects addressing different challenges in the analysis of functional and high dimensional data. In Project 1, the investigators introduce a new operator-valued quantity to characterize the conditional mean (in)dependence of one function-valued random element given another, and apply the newly developed dependent metrics to do dimension reduction for functional time series under a new framework of finite dimensional functional data. In Project 2, the investigators explore a new dimension reduction framework for regression models with high dimensional response, which requires less stringent linear model assumptions and is more flexible in terms of capturing possible nonlinear dependence between the response and the covariates. In Project 3, the investigators develop new tests for the mutual independence of high dimensional data via distance covariance and rank distance covariance using both sum of squares and maximum type test statistics. Overall, the three lines of research are all related to big data, and they touch upon various aspects of modern statistics; the project aims to push the current frontiers in areas including sparse principal component analysis, inference for dependent functional data, and high dimensional multivariate analysis to another level.

由于信息技术的快速发展及其在气候科学、医学影像、金融等众多科学领域的应用，高维数据和无限维函数数据的统计分析变得越来越重要。与此类大数据分析相关的一个关键挑战是如何测量和推断复杂的依赖结构，这是统计学的基本步骤，并且由于数据的高维度和巨大的规模而变得更加困难。该研究项目的主要目标是开发新的相关性度量，用于量化大规模数据集（例如时间相关函数数据和高维数据）的相关性，并利用这些新度量开发新颖的统计工具，以进行稀疏主成分分析、降维和同时假设检验。基于可以捕获非线性和非单调依赖性的新依赖性度量，正在开发的方法预计将带来更准确的预测和推理，以及在功能和高维数据分析中更有效的降维。该研究由三个项目组成，旨在解决功能数据和高维数据分析中的不同挑战。在项目1中，研究人员引入了一种新的算子值量来表征一个函数值随机元素对另一个函数值的条件均值（in）依赖性，并应用新开发的相关度量在有限维函数数据的新框架下对函数时间序列进行降维。在项目2中，研究人员探索了一种新的高维响应回归模型降维框架，该框架需要不太严格的线性模型假设，并且在捕获响应和协变量之间可能的非线性依赖性方面更加灵活。在项目 3 中，研究人员使用平方和和最大类型检验统计量，通过距离协方差和等级距离协方差开发了高维数据相互独立性的新检验。总体而言，这三个研究方向都与大数据相关，并且涉及现代统计学的各个方面；该项目旨在将稀疏主成分分析、相关函数数据推理和高维多元分析等领域的当前前沿推向另一个水平。