Estimation of High Dimensional Matrices of Low Effective Rank with Applications to Structural Copula Models
Estimation of High Dimensional Matrices of Low Effective Rank with Applications to Structural Copula Models
批准号:
1310119
负责人:
Marten Wegkamp
金额:
$20.0万
依托单位:
依托单位国家:
美国
项目类别:
Continuing Grant
财政年份:
2013
资助国家:
美国
项目状态:
已结题
起止时间:
2013-07-01 至 2016-06-30
中文摘要
这一建议的中心目标是:(A)在各种矩阵范数下提供关于降维有效秩高维协方差矩阵的样本协方差估计的精度的精确有限样本界;(B)将这些结果推广到函数数据并刻画降维有效秩协方差算子的类。利用这些结果开发完全数据驱动的方法,在有限样本中进行特征值和特征向量的选择,具有很强的理论合理性。将这些结果应用于机动车尾气排放建模;(C)研究椭圆Copula高维相关矩阵的因子模型。以获得这些矩阵的极小极大估计,并将这些结果用于乳腺癌数据中的分类问题。在稀疏约束下,我们的研究与已有的协方差或相关矩阵估计结果之间存在着有趣的联系。然而,现有稀疏性类型(逐项、逐行、非对角线衰减)下的估计不能用于对一般类型的依赖关系进行建模。拟议的工作弥合了这一差距,并提出了不同的数学和计算挑战。在许多科学学科中,高维数据建模和评估其可变性提出了越来越多的挑战。例如,遗传学和分子生物学中的网络数据建模;经济学中的高维投资组合建模;以及心理学、公共卫生、交通和城市规划中的曲线样本,都会遇到这样的挑战。只要数据是由具有低维结构的模型生成的,就可以提供实质上更好的解决方案。在高维协方差和相关矩阵估计的统计问题中,该建议将形成相关的低维结构概念(例如,低有效秩或近似低维因子模型)。在高维模型中,特别是在函数数据环境中,对各类协方差矩阵进行系统研究的必要性直到最近几年才开始被认识到。因此,这项提议是对这一重要领域目前有限的方法和理论成果的及时补充。这些技术的实用性将通过对基因组学、蛋白质组学和环境工程数据的应用来证明。实施所开发方法的免费软件将以易于实施的形式在网上提供。
英文摘要
The central goals of this proposal are:(a) To provide sharp finite sample bounds, in various matrix norms, on the accuracy of the sample covariance estimator of high dimensional covariance matrices of reduced effective rank;(b) To extend these results to functional data and characterize classes of covariance operators of reduced effective rank. To use these results to develop fully data driven methods, with strong theoretical justification, for eigenvalue and eigenvector selection, in finite samples. To apply these results to modeling vehicle emissions exhaust; (c) To study factor models of high dimensional correlation matrices of elliptical copulas. To obtain minimax estimators of these matrices and to use these results in classification problems in breast cancer data. There are interesting connections between our proposed research and existing results on estimation of covariance or correlation matrices under sparsity constrains. However, estimation under the existing sparsity types (entry-wise, row-wise, off-diagonal decay) cannot be used for modeling general types of dependency. The proposed work bridges this gap, and poses different mathematical and computational challenges. Modeling high dimensional data and evaluating their variability presents increasing challenges in many scientific disciplines. For instance, such challenges occur in modeling network data in genetics and molecular biology; high dimensional portfolios in economics; and samples of curves in psychology, public health, transportation and urban planning. Substantially better solutions can be provided whenever the data is generated by a model with low dimensional structure. In the statistical problem of high dimensional covariance and correlation matrix estimation, this proposal will formulate the relevant notion of low dimensional structure (for instance, low effective rank or approximate low dimensional factor models). The need for a systematic investigation of various classes of covariance matrices in high dimensional models, especially in functional data settings, only begun to be recognized in recent years. This proposal is therefore a timely addition to the currently limited battery of methods and theoretical results in this important area. The usefulness of these techniques will be demonstrated by applications to data from genomics, proteomics and environmental engineering. Free software that implements the developed methodology will be made available on the web in a readily implementable form.
期刊论文(2)
专著(0)
科研奖励(0)
会议论文
Weak convergence of empirical copula processes indexed by functions
按函数索引的经验关联过程的弱收敛性
DOI:
10.3150/16-bej849
发表时间:
2017
期刊:
Bernoulli
影响因子:
1.5
作者:
[Radulović, Dragan, Wegkamp, Marten, Zhao, Yue]
通讯作者:
Zhao, Yue
DOI:
10.1016/j.jspi.2017.09.006
发表时间:
2018
期刊:
Journal of Statistical Planning and Inference
影响因子:
0.9
作者:
[Radulović, Dragan, Wegkamp, Marten]
通讯作者:
Wegkamp, Marten
Discriminant Analysis in High-Dimensional Latent Factor Models
-
批准号:2210557
-
项目类别:Standard Grant
-
资助金额:$18.0万
-
财政年份:2022
-
负责人:Marten Wegkamp
-
依托单位:
Sparsity oracle inequalities via l_1 regularization in nonparametric models
-
批准号:0706829
-
项目类别:Continuing Grant
-
资助金额:$24.31万
-
财政年份:2007
-
负责人:Marten Wegkamp
-
依托单位:
国内基金
海外基金
Scalable Learning and Optimization: High-dimensional Models and Online Decision-Making Strategies for Big Data Analysis
-
批准号:--
-
项目类别:合作创新研究团队
-
资助金额:--
-
批准年份:2024
-
负责人:姚韬
-
依托单位: