The dual step size of the alternating direction method can be larger than 1.618 when one function is strongly convex

The dual step size of the alternating direction method can be larger than 1.618 when one function is strongly convex
复制标题

当一个函数是强凸函数时,交替方向法的双步长可以大于1.618

DOI:
10.3934/jimo.2020016
复制
发表时间:
2021
影响因子:
1.3
通讯作者:
Wu Jian
Wu Jian
中科院分区:
工程技术4区
文献类型:
--
作者:
Ma Feng;Shu Jiansheng;Li Yaxiong;Wu Jian

文献摘要

参考文献

相似文献

交替方向乘子法(ADMM)是求解线性约束可分凸优化问题的一种著名的优化方法。在文献中,Fortin和Glowinski证明了用于更新ADMM的拉格朗日乘子的步长可以在零到黄金比例的开区间内选择。但是,双步长是否可以大于黄金分割比仍然是未知的。本文对函数项为强凸且相关系数矩阵为满列秩的情形,给出了上述问题的肯定回答。然后,我们推导出一个确切的模和双步长之间的关系。我们的分析加深了对ADMM收敛性质的理解。
The alternating direction method of multipliers (ADMM) is one of the most well-known optimization scheme for solving linearly constrained separable convex problem. In the literature, Fortin and Glowinski proved that the step size for updating the Lagrange multiplier of the ADMM can be chosen in the open interval of zero to the golden ratio. But, it is still unknown whether the dual step size can be larger than the golden ratio. In this paper, for the case where one function term is strongly convex and the associate coefficient matrix is full column rank, we present an affirmative answer to the above question. We then derive an exact relationship between the modulus and the dual step size. Our analysis deepens the understanding of the convergence properties of the ADMM.
DOI: --
发表时间: 2011-12
影响因子: 6.4
作者:
F. Bach;Rodolphe Jenatton;J. Mairal
通讯作者: F. Bach;Rodolphe Jenatton;J. Mairal
DOI: 10.1007/bf01581204
发表时间: 1992-07-06
影响因子: 2.7
作者:
ECKSTEIN, J;BERTSEKAS, DP
通讯作者: BERTSEKAS, DP
DOI: 10.1007/s10107-016-1034-2
发表时间: 2017-03-01
影响因子: 2.7
作者:
Hong, Mingyi;Luo, Zhi-Quan
通讯作者: Luo, Zhi-Quan
DOI: 10.1115/1.3169136
发表时间: 1985-09
期刊: Journal of Applied Mechanics
影响因子: --
作者:
R. Glowinski;J. Oden
通讯作者: R. Glowinski;J. Oden
DOI: 10.1007/s12532-010-0017-1
发表时间: 2010-09
影响因子: 6.3
作者:
Zaiwen Wen;D. Goldfarb;W. Yin
通讯作者: Zaiwen Wen;D. Goldfarb;W. Yin