A Comprehensive Framework for Fully Efficient Robust Estimation and Variable Selection, with Application to High-Dimensional and Complex Data
A Comprehensive Framework for Fully Efficient Robust Estimation and Variable Selection, with Application to High-Dimensional and Complex Data
批准号:
1308400
负责人:
Howard Bondell
金额:
$15.0万
依托单位国家:
美国
项目类别:
Continuing Grant
财政年份:
2013
资助国家:
美国
项目状态:
已结题
起止时间:
2013-08-01 至 2018-07-31
中文摘要
本研究在当今复杂数据结构的背景下解决了估计和变量选择的稳健性。该研究的首要主题是,仔细指定的力矩限制与适当的数据加权相结合,将导致在非典型观测存在下保持稳定的估计和变量选择完全有效的理想目标。该方法是通过广义经验似然发展起来的,它产生了每个观测值的估计权重。在这个过程中,这会自动降低可能偏离模型的观测值的权重,从而降低它们的影响。同时,即使在有限的样本中,与完全有效的基于模型的估计器相比,如果模型被正确指定,估计器的效率也没有损失。采用这种观点,可以为构建健壮且有效的过程提供统一的框架,这些过程可以为各种模型开发。效率和鲁棒性的基础允许将变量选择构建到处理方法中,不仅是中等,而且是高维设置。由于基线方法的性能,污染和错误规范下的变量选择一致性可以改进现有的选择方法,这些方法依赖于一个可能已经不鲁棒或不完全有效的起点。现代科学数据的特点是信息量丰富。数据爆炸出现在从药物发现到金融市场甚至国土安全的各个领域。虽然大量数据的涌入导致了这些领域的突破,但它也带来了许多统计问题。特别是,确定提供合适模型的相关预测变量可能是一项艰巨的任务。同时,在今天复杂的数据下,这个假设的模型肯定只是对现实的简化。因此,不可避免的是,一些数据将偏离模型,也许是显著的偏离,尽管它对大量数据仍然有用,并且可以提供有意义的见解。本研究的目标是开发执行估计和变量选择的技术的基本任务,同时也允许一些数据偏离模型而不会对结果产生很大影响。本研究开发的方法对异常值和模型错误规范具有鲁棒性,即使在存在这种污染的情况下,仍然保持估计和变量选择的效率。因此,它将是在面对复杂数据时实现有意义结果的关键组件。
英文摘要
This research addresses robustness in both estimation and variable selection within the context of today's complex data structures. The overarching theme of the research is that carefully specified moment restrictions combined with appropriate weighting of the data will lead to the ideal goals of full efficiency in estimation and variable selection which remains stable in the presence of atypical observations. The methodology is developed via generalized empirical likelihood, which yields estimated weights for each observation. In the process, this automatically downweights observations that may deviate from the model, thus reducing their influence. Meanwhile, the estimators have no loss of efficiency compared with the fully efficient model-based estimator if the model were correctly specified, even in finite samples. Taking this point of view allows a unified framework to the construction of robust and efficient procedures that can be developed for a variety of models. The foundation of efficiency and robustness allows variable selection to be built into the methods to handle, not only the moderate, but also the high-dimensional setting. Due to the performance of the baseline approach, the variable selection consistency under contamination and misspecification can improve on existing selection methods that rest on a starting point that may be already non-robust or less than fully efficient. Modern scientific data is characterized by a wealth of information. The data explosion has arisen in diverse areas running the gamut from drug discovery to the financial markets and even homeland security. While the massive influx of data has led to breakthroughs in these fields, it brings many statistical issues to the forefront. In particular, it can be an overwhelming task to determine the relevant predictor variables that provide a suitable model. Meanwhile, with today's complex data, this postulated model will surely be only a simplification of reality. Thus it is inevitable that some of the data will deviate, perhaps significantly, from the model, although it is still useful for the bulk of the data and can provide meaningful insight. This research targets the essential task of developing techniques to perform estimation and variable selection, while also allowing for some of the data to deviate from the model without greatly affecting the results. The methods developed from this research are robust to outliers and model misspecification, while still maintaining efficiency for both estimation and variable selection even in the presence of this contamination. Thus it will be a key component to enable meaningful results in the face of complex data.
期刊论文(0)
专著(0)
科研奖励(0)
会议论文
Shrinkage Methods for Variable Selection and Structure Discovery, with Applications to High Dimensional Data
-
批准号:1005612
-
项目类别:Standard Grant
-
资助金额:$13.0万
-
财政年份:2010
-
负责人:Howard Bondell
-
依托单位:
Advances in Variable Selection with Grouped Predictors
-
批准号:0705968
-
项目类别:Standard Grant
-
资助金额:$14.0万
-
财政年份:2007
-
负责人:Howard Bondell
-
依托单位:
海外基金