A primal-dual flow for affine constrained convex optimization

被引:9
|
作者
Luo, Hao [1 ]
机构
[1] Peking Univ, Sch Math Sci, Beijing 100871, Peoples R China
关键词
Convex optimization; linear constraint; dynamical system; Lyapunov function; exponential decay; discretization; nonergodic linear rate; primal-dual algorithm; semi-smooth Newton method; l(1)-l(2) minimization; total-variation model; ALTERNATING DIRECTION METHOD; LINEAR CONVERGENCE; GRADIENT METHODS; ALGORITHMS; FRAMEWORK; DYNAMICS; NEWTON; STABILITY;
D O I
10.1051/cocv/2022032
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We introduce a novel primal-dual flow for affine constrained convex optimization problems. As a modification of the standard saddle-point system, our flow model is proved to possess the exponential decay property, in terms of a tailored Lyapunov function. Then two primal-dual methods are obtained from numerical discretizations of the continuous problem, and global nonergodic linear convergence rate is established via a discrete Lyapunov function. Instead of solving the subproblem of the primal variable, we apply the semi-smooth Newton iteration to the inner problem with respect to the multiplier, provided that there are some additional properties such as semi-smoothness and sparsity. Finally, numerical tests on the linearly constrained l(1)-l(2) minimization and the tot al-variation based image denoising model have been provided.
引用
收藏
页数:34
相关论文
共 50 条
  • [1] Primal-dual stochastic distributed algorithm for constrained convex optimization
    Niu, Youcheng
    Wang, Haijing
    Wang, Zheng
    Xia, Dawen
    Li, Huaqing
    [J]. JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2019, 356 (16): : 9763 - 9787
  • [2] Primal-dual subgradient method for constrained convex optimization problems
    Metel, Michael R.
    Takeda, Akiko
    [J]. OPTIMIZATION LETTERS, 2021, 15 (04) : 1491 - 1504
  • [3] Primal-dual subgradient method for constrained convex optimization problems
    Michael R. Metel
    Akiko Takeda
    [J]. Optimization Letters, 2021, 15 : 1491 - 1504
  • [4] Projected Primal-Dual Dynamics for Distributed Constrained Nonsmooth Convex Optimization
    Zhu, Yanan
    Yu, Wenwu
    Wen, Guanghui
    Chen, Guanrong
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (04) : 1776 - 1782
  • [5] A Universal Primal-Dual Convex Optimization Framework
    Yurtsever, Alp
    Quoc Tran-Dinh
    Cevher, Volkan
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 28 (NIPS 2015), 2015, 28
  • [6] Hierarchical Convex Optimization With Primal-Dual Splitting
    Ono, Shunsuke
    Yamada, Isao
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2015, 63 (02) : 373 - 388
  • [7] Primal-Dual Solution Perturbations in Convex Optimization
    A. L. Dontchev
    R. T. Rockafellar
    [J]. Set-Valued Analysis, 2001, 9 : 49 - 65
  • [8] Primal-dual solution perturbations in convex optimization
    Dontchev, AL
    Rockafellar, RT
    [J]. SET-VALUED ANALYSIS, 2001, 9 (1-2): : 49 - 65
  • [9] Primal-dual algorithm for distributed constrained optimization
    Lei, Jinlong
    Chen, Han-Fu
    Fang, Hai-Tao
    [J]. SYSTEMS & CONTROL LETTERS, 2016, 96 : 110 - 117
  • [10] Accelerated primal-dual proximal block coordinate updating methods for constrained convex optimization
    Xu, Yangyang
    Zhang, Shuzhong
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2018, 70 (01) : 91 - 128