SparseNet: Coordinate Descent With Nonconvex Penalties.

SparseNet: Coordinate Descent With Nonconvex Penalties.
复制标题

DOI:
10.1198/jasa.2011.tm09738
复制
发表时间:
2011
影响因子:
3.7
通讯作者:
Hastie T
Hastie T
中科院分区:
数学1区
文献类型:
--
作者:
Mazumder R;Friedman JH;Hastie T

文献摘要

参考文献

被引文献

相似文献

我们解决线性模型中的稀疏选择问题。为此,文献中提出了许多非凸惩罚,以及各种用于寻找良好解决方案的凸松弛算法。在本文中,我们采用坐标下降方法进行优化,并研究其收敛特性。我们描述了适合这种方法的惩罚的属性,研究了它们相应的阈值函数,并描述了有助于我们的路径算法的 df 标准化重参数化。 MC+ 惩罚非常适合此任务,我们用它来演示我们算法的性能。与本文相关的某些技术推导和实验包含在补充材料部分。
We address the problem of sparse selection in linear models. A number of nonconvex penalties have been proposed in the literature for this purpose, along with a variety of convex-relaxation algorithms for finding good solutions. In this article we pursue a coordinate-descent approach for optimization, and study its convergence properties. We characterize the properties of penalties suitable for this approach, study their corresponding threshold functions, and describe a df-standardizing reparametrization that assists our pathwise algorithm. The MC+ penalty is ideally suited to this task, and we use it to demonstrate the performance of our algorithm. Certain technical derivations and experiments related to this article are included in the Supplementary Materials section.
DOI: 10.1214/09-aos729
发表时间: 2010-04-01
影响因子: 4.5
作者:
Zhang, Cun-Hui
通讯作者: Zhang, Cun-Hui
DOI: 10.1214/009053607000000802
发表时间: 2008-08-01
影响因子: 4.5
作者:
Zou, Hui;Li, Runze
通讯作者: Li, Runze
DOI: 10.1002/cpa.20132
发表时间: 2006-06-01
影响因子: 3
作者:
Donoho, DL
通讯作者: Donoho, DL
DOI: 10.1214/07-aos520
发表时间: 2008-08-01
影响因子: 4.5
作者:
Zhang, Cun-Hui;Huang, Jian
通讯作者: Huang, Jian
DOI: 10.1093/imanum/20.3.389
发表时间: 2000-07-01
影响因子: 2.1
作者:
Osborne, MR;Presnell, B;Turlach, BA
通讯作者: Turlach, BA