Sufficient dimension reduction of high-dimensional data through regularized covariance estimation

通过正则化协方差估计对高维数据进行充分降维

• 批准号: 1105650
• 负责人: Adam Rothman
• 金额: $ 19.53万
• 依托单位: University of Minnesota-Twin Cities
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2011
• 资助国家: 美国
• 起止时间: 2011-07-01 至 2015-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1105650&HistoricalAwards=false
• 关键词: Sufficient; dimension; reduction; dimensional; data

Many statistical methods for dimensionality reduction, classification, and prediction, require an estimate of a covariance or precision matrix. In high-dimensional settings, (where the number of variables is larger than the sample size), it is known that classical covariance estimation with the sample covariance performs poorly. This has lead to a wealth of alternative regularized high-dimension covariance estimators, many of which have been proposed in the last decade. These estimators have been analyzed primarily in terms of how they perform when estimating the population covariance or precision matrix directly, rather than how they affect the performance of the statistical methods that require a regularized covariance estimate. A particular class of statistical methods of interest is those that perform sufficient dimension reduction (SDR), a powerful approach to reduce the dimensionality of the predictor in regression problems. Most of the SDR methodology and theory requires the number of variables to be less than the sample size, preventing its application to high-dimensional data. The PI, Co-PI, and their colleagues adapt sufficient dimension reduction methodology to high-dimensional settings via regularized covariance estimation. Specifically, they develop alternative SDR methodology, high-dimensional asymptotic analysis (as both the number of variables and the sample size grow), efficient computational algorithms, and applications to data.Genetics, spectroscopy, climate studies, and remote sensing are a few examples of the many research fields that produce high-dimensional data; these are data with many more measured characteristics than subjects or cases. Many standard statistical methods for prediction, classification, and data reduction are either inapplicable or perform poorly in this setting. In response, statistical methods to extract a subset of the measured characteristics for use in predictive models have been developed; however, these methods operate under the assumption that a relatively small number of measured characteristics are relevant for prediction. The investigators address this deficiency by developing new methods for the reduction of high-dimensional data for use in predictive modeling, which unlike many existing methods, are able to extract relevant predictive information from all of the measured characteristics. In addition, the investigators develop publicly available computer software to implement these new methods, enabling their application by researchers and practitioners in many fields.

许多用于降维、分类和预测的统计方法需要估计协方差或精度矩阵。 在高维设置中（变量数量大于样本大小），众所周知，使用样本协方差的经典协方差估计表现不佳。 这导致了大量替代正则化高维协方差估计器的出现，其中许多是在过去十年中提出的。这些估计量主要是根据它们在直接估计总体协方差或精度矩阵时的表现来分析的，而不是根据它们如何影响需要正则化协方差估计的统计方法的性能来分析的。 令人感兴趣的一类特定统计方法是那些执行足够降维 (SDR) 的方法，这是一种降低回归问题中预测变量维度的强大方法。大多数SDR方法和理论要求变量数量小于样本量，这阻碍了其应用于高维数据。 PI、Co-PI 及其同事通过正则化协方差估计将足够的降维方法应用于高维设置。 具体来说，他们开发了替代 SDR 方法、高维渐近分析（随着变量数量和样本量的增长）、高效的计算算法以及数据应用。遗传学、光谱学、气候研究和遥感是产生高维数据的许多研究领域的几个例子；这些数据比受试者或案例具有更多可测量的特征。 许多用于预测、分类和数据缩减的标准统计方法在这种情况下要么不适用，要么表现不佳。 作为回应，已经开发出统计方法来提取测量特征的子集以用于预测模型；然而，这些方法的运行假设是相对少量的测量特征与预测相关。 研究人员通过开发新方法来减少用于预测建模的高维数据来解决这一缺陷，与许多现有方法不同，该方法能够从所有测量的特征中提取相关的预测信息。 此外，研究人员还开发了公开可用的计算机软件来实施这些新方法，使它们能够被许多领域的研究人员和从业者应用。