An accelerated distributed method with inexact model of relative smoothness and strong convexity

被引:0
|
作者
Zhang, Xuexue [1 ]
Liu, Sanyang [1 ]
Zhao, Nannan [2 ]
机构
[1] Xidian Univ, Sch Math & Stat, Xian, Peoples R China
[2] Changan Univ, Sch Sci, Xian, Peoples R China
基金
中国国家自然科学基金;
关键词
communication complexity; computational complexity; convergence; distributed algorithms; distributed control; SUBGRADIENT METHODS; CONVERGENCE; OPTIMIZATION; TIME; COMMUNICATION; ALGORITHM;
D O I
10.1049/sil2.12199
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Distributed optimisation methods are widely applied in many systems where agents cooperate with each other to minimise a sum-type problem over a connected network. An accelerated distributed method based on the inexact model of relative smoothness and strong convexity is introduced by the authors. The authors demonstrate that the proposed method can converge to the optimal solution at the linear rate 1(1+1/(4 root kappa g))2 and achieve the optimal gradient computation complexity and the near optimal communication complexity, where kappa(g) denotes the global condition number. Finally, the numerical experiments are provided to validate the theoretical results and further show the efficacy of the proposed method.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] RSG: Beating Subgradient Method without Smoothness and Strong Convexity
    Yang, Tianbao
    Lin, Qihang
    JOURNAL OF MACHINE LEARNING RESEARCH, 2018, 19 : 1 - 33
  • [3] On strong asymptotic uniform smoothness and convexity
    Luis García-Lirola
    Matías Raja
    Revista Matemática Complutense, 2018, 31 : 131 - 152
  • [4] On strong asymptotic uniform smoothness and convexity
    Garcia-Lirola, Luis
    Raja, Matias
    REVISTA MATEMATICA COMPLUTENSE, 2018, 31 (01): : 131 - 152
  • [5] Restarting the accelerated coordinate descent method with a rough strong convexity estimate
    Olivier Fercoq
    Zheng Qu
    Computational Optimization and Applications, 2020, 75 : 63 - 91
  • [6] Restarting the accelerated coordinate descent method with a rough strong convexity estimate
    Fercoq, Olivier
    Qu, Zheng
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2020, 75 (01) : 63 - 91
  • [7] Investigation of smoothness conditions on the boundary for the strong linear convexity of a domain
    V. L. Mel’nik
    Ukrainian Mathematical Journal, 1999, 51 (12) : 1935 - 1938
  • [8] MUSIC: Accelerated Convergence for Distributed Optimization With Inexact and Exact Methods
    Wu, Mou
    Liao, Haibin
    Ding, Zhengtao
    Xiao, Yonggang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, : 1 - 15
  • [9] Strong Convexity and Smoothness of Solutions to Geometric Optics Problems via Dynamic Programming
    Gnecco, Giorgio
    Selvi, Daniela
    IEEE CONTROL SYSTEMS LETTERS, 2018, 2 (03): : 549 - 554
  • [10] Linear Convergence for Distributed Optimization Without Strong Convexity
    Yi, Xinlei
    Zhang, Shengjun
    Yang, Tao
    Chai, Tianyou
    Johansson, Karl H.
    2020 59TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2020, : 3643 - 3648