Converting ADMM to a proximal gradient for efficient sparse estimation

Converting ADMM to a proximal gradient for efficient sparse estimation
复制标题

将 ADMM 转换为近端梯度以进行有效的稀疏估计

DOI:
10.1007/s42081-022-00150-6
复制
发表时间:
2022
影响因子:
1.3
通讯作者:
Suzuki Joe
Suzuki Joe
中科院分区:
--
文献类型:
--
作者:
Shimmura Ryosuke;Suzuki Joe

文献摘要

参考文献

相似文献

在稀疏估计中,如融合套索和凸聚类,我们使用近似梯度法或乘子交替方向法(ADMM)来解决这个问题。在前一种情况下包括矩阵除法需要花费时间,而在后一种情况下已经开发出一种有效的方法,如FISTA(快速迭代收缩阈值算法)。本文在假设目标函数的导数是Lipschitz连续的前提下,提出了将ADMM解转化为近似梯度法的一般方法。然后,我们将其应用于稀疏估计问题,如稀疏凸聚类、趋势滤波等,数值实验表明,该算法在效率上有了显著的提高。
In sparse estimation, such as fused lasso and convex clustering, we apply either the proximal gradient method or the alternating direction method of multipliers (ADMM) to solve the problem. It takes time to include matrix division in the former case, while an efficient method such as FISTA (fast iterative shrinkage-thresholding algorithm) has been developed in the latter case. This paper proposes a general method for converting the ADMM solution to the proximal gradient method, assuming that assumption that the derivative of the objective function is Lipschitz continuous. Then, we apply it to sparse estimation problems, such as sparse convex clustering and trend filtering, and we show by numerical experiments that we can obtain a significant improvement in terms of efficiency.
DOI: 10.1109/tac.1974.1100705
发表时间: 1974-01-01
影响因子: 6.8
作者:
AKAIKE, H
通讯作者: AKAIKE, H
DOI: 10.1137/080716542
发表时间: 2009-01-01
影响因子: 2.1
作者:
Beck, Amir;Teboulle, Marc
通讯作者: Teboulle, Marc
使用数学和 R 进行稀疏估计:构建逻辑的 100 个练习
DOI: --
发表时间: 2021
期刊:
影响因子: --
作者:
Suzuki;Joe
通讯作者: Joe