Confidence Intervals for Sparse Penalized Regression with Random Designs.

Confidence Intervals for Sparse Penalized Regression with Random Designs.
复制标题

DOI:
10.1080/01621459.2019.1585251
复制
发表时间:
2020
影响因子:
3.7
通讯作者:
Liu Y
Liu Y
中科院分区:
数学1区
文献类型:
--
作者:
Yu G;Yin L;Lu S;Liu Y

文献摘要

参考文献

相似文献

随着大数据的丰富,稀疏惩罚回归技术由于具有同时进行变量选择和估计的优点而常用于数据分析。文献中已经提出了许多凸和非凸惩罚来实现稀疏估计。尽管该领域的工作很紧张,但如何对具有一般惩罚的稀疏惩罚回归进行有效的推理仍然是一个活跃的研究问题。在本文中,通过利用随机变分不等式理论中最先进的优化工具,我们提出了一个统一的框架来构建稀疏惩罚回归的置信区间,该回归具有广泛的惩罚,包括凸和非凸惩罚。我们研究了惩罚回归的总体版本下的参数推断以及基础线性模型的参数。获得了所提出方法的理论收敛特性。提供了几个模拟和真实数据示例来证明所提出的推理过程的有效性和有效性。
With the abundance of large data, sparse penalized regression techniques are commonly used in data analysis due to the advantage of simultaneous variable selection and estimation. A number of convex as well as non-convex penalties have been proposed in the literature to achieve sparse estimates. Despite intense work in this area, how to perform valid inference for sparse penalized regression with a general penalty remains to be an active research problem. In this paper, by making use of state-of-the-art optimization tools in stochastic variational inequality theory, we propose a unified framework to construct confidence intervals for sparse penalized regression with a wide range of penalties, including convex and non-convex penalties. We study the inference for parameters under the population version of the penalized regression as well as parameters of the underlying linear model. Theoretical convergence properties of the proposed method are obtained. Several simulated and real data examples are presented to demonstrate the validity and effectiveness of the proposed inference procedure.
DOI: 10.1214/09-aos729
发表时间: 2010-04-01
影响因子: 4.5
作者:
Zhang, Cun-Hui
通讯作者: Zhang, Cun-Hui
DOI: 10.1137/13090506x
发表时间: 2014-01-01
影响因子: 3.1
作者:
Lu, Shu
通讯作者: Lu, Shu
DOI: 10.1198/jasa.2011.tm09738
发表时间: 2011
影响因子: 3.7
作者:
Mazumder R;Friedman JH;Hastie T
通讯作者: Hastie T
DOI: 10.1214/15-aos1371
发表时间: 2016-06-01
影响因子: 4.5
作者:
Lee, Jason D.;Sun, Dennis L.;Taylor, Jonathan E.
通讯作者: Taylor, Jonathan E.
DOI: 10.1111/rssb.12026
发表时间: 2014-01-01
影响因子: 5.8
作者:
Zhang, Cun-Hui;Zhang, Stephanie S.
通讯作者: Zhang, Stephanie S.