Accelerated Primal-Dual Mirror Dynamics for Centralized and Distributed Constrained Convex Optimization Problems

被引:0
|
作者
Zhao, You [1 ]
Liao, Xiaofeng [2 ]
He, Xing [3 ]
Zhou, Mingliang [2 ]
Li, Chaojie [4 ]
机构
[1] Southwest Univ, Coll Elect & Informat Engn, Chongqing 400044, Peoples R China
[2] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[3] Southwest Univ, Coll Elect & Informat Engn, Chongqing 400715, Peoples R China
[4] North China Elect Power Univ, State Key Lab Alternate Elect Power Syst Renewable, Beijing 102206, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
machine learning; accelerated mirror dynamical approaches; constrained smooth and nonsmooth convex optimization; smoothing approximation; distributed approaches; 2ND-ORDER EVOLUTION EQUATION; CONVERGENCE-RATES; NEURAL-NETWORK; NONSMOOTH; MINIMIZATION; SYSTEM; ASYMPTOTICS; STABILITY; ALGORITHM;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper investigates two accelerated primal-dual mirror dynamical approaches for smooth and nonsmooth convex optimization problems with affine and closed, convex set constraints. In the smooth case, an accelerated primal-dual mirror dynamical approach (APDMD) based on accelerated mirror descent and primal-dual framework is proposed and accelerated convergence properties of primal-dual gap, feasibility measure and the objective function value along with trajectories of APDMD are derived by the Lyapunov analysis method. Then, we extend APDMD into two distributed dynamical approaches to deal with two types of distributed smooth optimization problems, i.e., distributed constrained consensus problem (DCCP) and distributed extended monotropic optimization (DEMO) with accelerated convergence guarantees. Moreover, in the nonsmooth case, we propose a smoothing accelerated primal-dual mirror dynamical approach (SAPDMD) with the help of smoothing approximation technique and the above APDMD. We further also prove that primal-dual gap, objective function value and feasibility measure along with trajectories of SAPDMD have the same accelerated convergence properties as APDMD by choosing the appropriate smooth approximation parameters. Later, we propose two smoothing accelerated distributed dynamical approaches to deal with nonsmooth DEMO and DCCP to obtain accelerated and efficient solutions. Finally, numerical and comparative experiments are given to demonstrate the effectiveness and superiority of the proposed accelerated mirror dynamical approaches.
引用
收藏
页数:59
相关论文
共 50 条
  • [31] Semi-global exponential stability of augmented primal-dual gradient dynamics for constrained convex optimization
    Tang, Yujie
    Qu, Guannan
    Li, Na
    [J]. SYSTEMS & CONTROL LETTERS, 2020, 144
  • [32] Primal-Dual Mirror Descent Method for Constraint Stochastic Optimization Problems
    Bayandina, A. S.
    Gasnikov, A. V.
    Gasnikova, E. V.
    Matsievskii, S. V.
    [J]. COMPUTATIONAL MATHEMATICS AND MATHEMATICAL PHYSICS, 2018, 58 (11) : 1728 - 1736
  • [33] Primal-dual incremental gradient method for nonsmooth and convex optimization problems
    Jalilzadeh, Afrooz
    [J]. OPTIMIZATION LETTERS, 2021, 15 (08) : 2541 - 2554
  • [34] Primal-dual incremental gradient method for nonsmooth and convex optimization problems
    Afrooz Jalilzadeh
    [J]. Optimization Letters, 2021, 15 : 2541 - 2554
  • [35] Primal-dual subgradient methods for convex problems
    Nesterov, Yurii
    [J]. MATHEMATICAL PROGRAMMING, 2009, 120 (01) : 221 - 259
  • [36] Primal-dual subgradient methods for convex problems
    Yurii Nesterov
    [J]. Mathematical Programming, 2009, 120 : 221 - 259
  • [37] A Universal Primal-Dual Convex Optimization Framework
    Yurtsever, Alp
    Quoc Tran-Dinh
    Cevher, Volkan
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 28 (NIPS 2015), 2015, 28
  • [38] Hierarchical Convex Optimization With Primal-Dual Splitting
    Ono, Shunsuke
    Yamada, Isao
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2015, 63 (02) : 373 - 388
  • [39] Primal-Dual Solution Perturbations in Convex Optimization
    A. L. Dontchev
    R. T. Rockafellar
    [J]. Set-Valued Analysis, 2001, 9 : 49 - 65
  • [40] Primal-dual solution perturbations in convex optimization
    Dontchev, AL
    Rockafellar, RT
    [J]. SET-VALUED ANALYSIS, 2001, 9 (1-2): : 49 - 65