Accelerated Primal-Dual Mirror Dynamics for Centralized and Distributed Constrained Convex Optimization Problems

被引:0
|
作者
Zhao, You [1 ]
Liao, Xiaofeng [2 ]
He, Xing [3 ]
Zhou, Mingliang [2 ]
Li, Chaojie [4 ]
机构
[1] Southwest Univ, Coll Elect & Informat Engn, Chongqing 400044, Peoples R China
[2] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[3] Southwest Univ, Coll Elect & Informat Engn, Chongqing 400715, Peoples R China
[4] North China Elect Power Univ, State Key Lab Alternate Elect Power Syst Renewable, Beijing 102206, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
machine learning; accelerated mirror dynamical approaches; constrained smooth and nonsmooth convex optimization; smoothing approximation; distributed approaches; 2ND-ORDER EVOLUTION EQUATION; CONVERGENCE-RATES; NEURAL-NETWORK; NONSMOOTH; MINIMIZATION; SYSTEM; ASYMPTOTICS; STABILITY; ALGORITHM;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper investigates two accelerated primal-dual mirror dynamical approaches for smooth and nonsmooth convex optimization problems with affine and closed, convex set constraints. In the smooth case, an accelerated primal-dual mirror dynamical approach (APDMD) based on accelerated mirror descent and primal-dual framework is proposed and accelerated convergence properties of primal-dual gap, feasibility measure and the objective function value along with trajectories of APDMD are derived by the Lyapunov analysis method. Then, we extend APDMD into two distributed dynamical approaches to deal with two types of distributed smooth optimization problems, i.e., distributed constrained consensus problem (DCCP) and distributed extended monotropic optimization (DEMO) with accelerated convergence guarantees. Moreover, in the nonsmooth case, we propose a smoothing accelerated primal-dual mirror dynamical approach (SAPDMD) with the help of smoothing approximation technique and the above APDMD. We further also prove that primal-dual gap, objective function value and feasibility measure along with trajectories of SAPDMD have the same accelerated convergence properties as APDMD by choosing the appropriate smooth approximation parameters. Later, we propose two smoothing accelerated distributed dynamical approaches to deal with nonsmooth DEMO and DCCP to obtain accelerated and efficient solutions. Finally, numerical and comparative experiments are given to demonstrate the effectiveness and superiority of the proposed accelerated mirror dynamical approaches.
引用
收藏
页数:59
相关论文
共 50 条
  • [1] Projected Primal-Dual Dynamics for Distributed Constrained Nonsmooth Convex Optimization
    Zhu, Yanan
    Yu, Wenwu
    Wen, Guanghui
    Chen, Guanrong
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (04) : 1776 - 1782
  • [2] Inertial accelerated primal-dual methods for linear equality constrained convex optimization problems
    He, Xin
    Hu, Rong
    Fang, Ya-Ping
    [J]. NUMERICAL ALGORITHMS, 2022, 90 (04) : 1669 - 1690
  • [3] Inertial accelerated primal-dual methods for linear equality constrained convex optimization problems
    Xin He
    Rong Hu
    Ya-Ping Fang
    [J]. Numerical Algorithms, 2022, 90 : 1669 - 1690
  • [4] Primal-dual stochastic distributed algorithm for constrained convex optimization
    Niu, Youcheng
    Wang, Haijing
    Wang, Zheng
    Xia, Dawen
    Li, Huaqing
    [J]. JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2019, 356 (16): : 9763 - 9787
  • [5] A Universal Accelerated Primal-Dual Method for Convex Optimization Problems
    Luo, Hao
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2024, 201 (01) : 280 - 312
  • [6] Primal-dual subgradient method for constrained convex optimization problems
    Metel, Michael R.
    Takeda, Akiko
    [J]. OPTIMIZATION LETTERS, 2021, 15 (04) : 1491 - 1504
  • [7] Primal-dual subgradient method for constrained convex optimization problems
    Michael R. Metel
    Akiko Takeda
    [J]. Optimization Letters, 2021, 15 : 1491 - 1504
  • [8] Inertial primal-dual dynamics with damping and scaling for linearly constrained convex optimization problems
    He, Xin
    Hu, Rong
    Fang, Ya-Ping
    [J]. APPLICABLE ANALYSIS, 2023, 102 (15) : 4114 - 4139
  • [9] Accelerated Primal-Dual Algorithm for Distributed Non-convex Optimization
    Zhang, Shengjun
    Bailey, Colleen P.
    [J]. 2021 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2021), 2021,
  • [10] A primal-dual method for conic constrained distributed optimization problems
    Aybat, Necdet Serhat
    Hamedani, Erfan Yazdandoost
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29