Generalized Sparse Additive Models

Generalized Sparse Additive Models
复制标题

DOI:
--
复制
发表时间:
2019-03
期刊:
Journal of machine learning research : JMLR
影响因子:
--
通讯作者:
Asad Haris;N. Simon;A. Shojaie
Asad Haris;N. Simon;A. Shojaie
中科院分区:
其他
文献类型:
--
作者:
Asad Haris;N. Simon;A. Shojaie

文献摘要

被引文献

相似文献

我们提出了一个统一的框架,估计和分析广义加性模型在高维。该框架定义了一大类惩罚回归估计,包括许多现有的方法。这一类的一个有效的计算算法,很容易扩展到数千个观察和功能。在弱相容条件下证明了这类问题的极大极小最优收敛界。此外,我们的收敛速度时,这种兼容性条件不满足的特点。最后,我们还表明,在我们的框架中,结构和稀疏性惩罚的最佳惩罚参数是相互关联的,允许交叉验证仅在单个调整参数上进行。我们补充我们的理论结果与实证研究比较,在这个框架内的一些现有的方法。
We present a unified framework for estimation and analysis of generalized additive models in high dimensions. The framework defines a large class of penalized regression estimators, encompassing many existing methods. An efficient computational algorithm for this class is presented that easily scales to thousands of observations and features. We prove minimax optimal convergence bounds for this class under a weak compatibility condition. In addition, we characterize the rate of convergence when this compatibility condition is not met. Finally, we also show that the optimal penalty parameters for structure and sparsity penalties in our framework are linked, allowing cross-validation to be conducted over only a single tuning parameter. We complement our theoretical results with empirical studies comparing some existing methods within this framework.