CAREER: High Dimensional Variable Selection and Risk Properties

职业：高维变量选择和风险属性

• 批准号: 0955316
• 负责人: Jinchi Lv
• 金额: $ 40万
• 依托单位: University of Southern California
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2010
• 资助国家: 美国
• 起止时间: 2010-09-01 至 2015-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0955316&HistoricalAwards=false
• 关键词: CAREER; Dimensional; Variable; Selection; Risk

High dimensional variable selection plays a pivotal role in contemporary statistical modeling, learning and scientific discoveries. Long-standing theoretical questions in the literature include how high dimensionality regularization methods with general penalties can handle, what the role of penalty functions is, and how to characterize the optimality of variable selection procedures. The investigator proposes to study four interrelated research topics. First, the investigator studies penalized likelihood methods with general penalties, which are widely applied for simultaneously selecting important variables and estimating their effects in high dimensional statistical inference, where the dimensionality can be much larger than sample size. Second, various contexts of high dimensional variable selection beyond penalized likelihood methods including penalized empirical risk and hunting for interactions are investigated. Third, the investigator proposes new principles for model selection when models are possibly misspecified and studies the robustness of various regularization methods for high dimensional variable selection under model misspecification. Fourth, the risk properties and optimality of various high dimensional regularization methods in the contexts of penalized least squares and penalized likelihood are further investigated.The analysis of vast data sets now commonly arises in diverse fields of sciences, engineering and humanities ranging from genomics and health sciences to economics, finance and machine learning. High dimensional data analysis poses numerous challenges to statistical theory, methods and implementations that are not present in smaller scale studies. A major goal of this proposal is to make theoretical and methodological contributions to the important and challenging topic of high dimensional variable selection and statistical inference. These new developments provide unified and systematic understandings of various regularization methods in high dimensions, and allow scientists to analyze high dimensional data with increased efficiency, expediency and interpretability. The proposed work is incorporated into new courses on the state-of-the-art high dimensional statistical learning, and will benefit the training and learning of undergraduates, graduate students, and underrepresented minorities. The proposed work on variable selection in high dimensions will not only help better identify factors that are important to, for example, public health and market risk, but also benefit a broad range of scientists and researchers in various fields.

高维变量选择在当代统计建模、学习和科学发现中起着关键作用。文献中长期存在的理论问题包括具有一般惩罚的高维正则化方法如何处理，惩罚函数的作用是什么，以及如何表征变量选择过程的最优性。研究者建议研究四个相互关联的研究课题。首先，研究者研究了具有一般惩罚的惩罚似然方法，该方法广泛应用于高维统计推断中同时选择重要变量并估计其影响，其中维数可能远远大于样本量。其次，研究了惩罚似然方法之外的高维变量选择的各种背景，包括惩罚经验风险和寻找相互作用。第三，提出了模型可能存在错定性时的模型选择新原则，并研究了各种正则化方法在模型错定性下高维变量选择的鲁棒性。第四，进一步研究了在惩罚最小二乘和惩罚似然环境下各种高维正则化方法的风险性质和最优性。现在，对大量数据集的分析通常出现在科学、工程和人文学科的各个领域，从基因组学和健康科学到经济学、金融学和机器学习。高维数据分析对统计理论、方法和实现提出了许多挑战，这些挑战在小规模研究中是不存在的。本提案的一个主要目标是对高维变量选择和统计推断这一重要而具有挑战性的课题做出理论和方法上的贡献。这些新的发展提供了对各种高维正则化方法的统一和系统的理解，并使科学家能够以更高的效率、方便性和可解释性分析高维数据。建议的工作被纳入最新的高维统计学习的新课程，并将有利于本科生，研究生和代表性不足的少数民族的培训和学习。关于高维变量选择的拟议工作不仅将有助于更好地确定对公共卫生和市场风险等重要因素，而且还将使各个领域的广泛科学家和研究人员受益。