Exponential convergence of distributed primal-dual convex optimization algorithm without strong convexity

被引:54
|
作者
Liang, Shu [1 ]
Wang, Le Yi [2 ]
Yin, George [3 ]
机构
[1] Univ Sci & Technol Beijing, Minist Educ, Key Lab Knowledge Automat Ind Proc, Sch Automat & Elect Engn, Beijing 100083, Peoples R China
[2] Wayne State Univ, Dept Elect & Comp Engn, Detroit, MI 48202 USA
[3] Wayne State Univ, Dept Math, Detroit, MI 48202 USA
基金
中国国家自然科学基金;
关键词
Distributed optimization; Convex optimization without strong convexity; Primal-dual algorithm; Exponential convergence; Rate of convergence; Metric subregularity; Variational analysis; LINEAR CONVERGENCE; ECONOMIC-DISPATCH; COORDINATION; CONSENSUS; NETWORK; ADMM;
D O I
10.1016/j.automatica.2019.04.004
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper establishes exponential convergence rates for a class of primal-dual gradient algorithms in distributed optimization without strong convexity. The convergence analysis is based on a carefully constructed Lyapunov function. By evaluating metric subregularity of the primal-dual gradient map, we present a general criterion under which the algorithm achieves exponential convergence. To facilitate practical applications of this criterion, several simplified sufficient conditions are derived. We also prove that although these results are developed for the continuous-time algorithms, they carry over in a parallel manner to the discrete-time algorithms constructed by using Euler's approximation method. (C) 2019 Elsevier Ltd. All rights reserved.
引用
收藏
页码:298 / 306
页数:9
相关论文
共 50 条
  • [1] Primal-dual stochastic distributed algorithm for constrained convex optimization
    Niu, Youcheng
    Wang, Haijing
    Wang, Zheng
    Xia, Dawen
    Li, Huaqing
    [J]. JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2019, 356 (16): : 9763 - 9787
  • [2] Linear convergence of a primal-dual algorithm for distributed interval optimization
    Wang, Yinghui
    Wang, Jiuwei
    Song, Xiaobo
    Hu, Yanpeng
    [J]. ELECTRONIC RESEARCH ARCHIVE, 2024, 32 (02): : 857 - 873
  • [3] A Primal-Dual Algorithm for Distributed Optimization
    Bianchi, P.
    Hachem, W.
    [J]. 2014 IEEE 53RD ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2014, : 4240 - 4245
  • [4] Linear Convergence of the Primal-Dual Gradient Method for Convex-Concave Saddle Point Problems without Strong Convexity
    Du, Simon S.
    Hu, Wei
    [J]. 22ND INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 89, 2019, 89 : 196 - 205
  • [5] Accelerated Primal-Dual Algorithm for Distributed Non-convex Optimization
    Zhang, Shengjun
    Bailey, Colleen P.
    [J]. 2021 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2021), 2021,
  • [6] A Primal-Dual Forward-Backward Splitting Algorithm for Distributed Convex Optimization
    Li, Huaqing
    Su, Enbing
    Wang, Chengbo
    Liu, Jiawei
    Zheng, Zuqing
    Wang, Zheng
    Xia, Dawen
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2023, 7 (01): : 278 - 284
  • [7] Primal-dual algorithm for distributed constrained optimization
    Lei, Jinlong
    Chen, Han-Fu
    Fang, Hai-Tao
    [J]. SYSTEMS & CONTROL LETTERS, 2016, 96 : 110 - 117
  • [8] Exponential Stability of Primal-Dual Gradient Dynamics with Non-Strong Convexity
    Chen, Xin
    Li, Na
    [J]. 2020 AMERICAN CONTROL CONFERENCE (ACC), 2020, : 1612 - 1618
  • [9] Distributed Primal-Dual Method for Convex Optimization With Coupled Constraints
    Su, Yanxu
    Wang, Qingling
    Sun, Changyin
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2022, 70 : 523 - 535
  • [10] Exponential Convergence of Primal-Dual Dynamics Under General Conditions and Its Application to Distributed Optimization
    Guo, Luyao
    Shi, Xinli
    Cao, Jinde
    Wang, Zihao
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (04) : 5551 - 5565