LINEARLY CONVERGENT DECENTRALIZED CONSENSUS OPTIMIZATION OVER DIRECTED NETWORKS

被引:0
|
作者
Nedic, Angelia [1 ]
Olshevsky, Alex [1 ]
Shi, Wei [1 ]
机构
[1] Univ Illinois, 1308 W Main St, Urbana, IL 61801 USA
关键词
Distributed optimization; directed network; linear convergence; small-gain theorem;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recently, there have been growing interests in solving distributed consensus optimization problems over directed networks that consist of multiple agents. In this paper, we develop a first-order (gradient-based) algorithm, referred to as Push-DIGing, for this class of problems. To run Push-DIGing, each agent in the network only needs to know its own out-degree and employs a fixed step-size. Under the strong convexity assumption, we prove that the introduced algorithm converges to the global minimizer at some R-linear (geometric) rate as long as the nonnegative step-size is no greater than some explicit bound.
引用
收藏
页码:485 / 489
页数:5
相关论文
共 50 条
  • [1] On arbitrary compression for decentralized consensus and stochastic optimization over directed networks
    Toghani, Mohammad Taha
    Uribe, César A.
    [J]. European Journal of Control, 2022, 68
  • [2] LINEARLY CONVERGENT DECENTRALIZED CONSENSUS OPTIMIZATION WITH THE ALTERNATING DIRECTION METHOD OF MULTIPLIERS
    Shi, Wei
    Ling, Qing
    Yuan, Kun
    Wu, Gang
    Yin, Wotao
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 4613 - 4617
  • [3] A Linearly Convergent Proximal Gradient Algorithm for Decentralized Optimization
    Alghunaim, Sulaiman A.
    Yuan, Kun
    Sayed, Ali H.
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [4] EXTRAPUSH FOR CONVEX SMOOTH DECENTRALIZED OPTIMIZATION OVER DIRECTED NETWORKS
    Zeng, Jinshan
    Yin, Wotao
    [J]. JOURNAL OF COMPUTATIONAL MATHEMATICS, 2017, 35 (04) : 383 - 396
  • [5] Compressed Gradient Tracking for Decentralized Optimization Over General Directed Networks
    Song, Zhuoqing
    Shi, Lei
    Pu, Shi
    Yan, Ming
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2022, 70 : 1775 - 1787
  • [6] Decentralized Bayesian Consensus over Networks
    Willert, Volker
    Haumann, Dominik
    Gering, Stefan
    [J]. 2014 EUROPEAN CONTROL CONFERENCE (ECC), 2014, : 1600 - 1606
  • [7] A Linearly Convergent Algorithm for Decentralized Optimization: Sending Less Bits for Free!
    Kovalev, Dmitry
    Koloskova, Anastasia
    Jaggi, Martin
    Richtarik, Peter
    Stich, Sebastian U.
    [J]. 24TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS (AISTATS), 2021, 130
  • [8] A decentralized Nesterov gradient method for stochastic optimization over unbalanced directed networks
    Hu, Jinhui
    Xia, Dawen
    Cheng, Huqiang
    Feng, Liping
    Ji, Lianghao
    Guo, Jing
    Li, Huaqing
    [J]. ASIAN JOURNAL OF CONTROL, 2022, 24 (02) : 576 - 593
  • [9] A fast proximal gradient algorithm for decentralized composite optimization over directed networks
    Zeng, Jinshan
    He, Tao
    Wang, Mingwen
    [J]. SYSTEMS & CONTROL LETTERS, 2017, 107 : 36 - 43
  • [10] A Linearly Convergent Robust Compressed Push-Pull Method for Decentralized Optimization
    Liao, Yiwei
    Li, Zhuorui
    Pu, Shi
    [J]. 2023 62ND IEEE CONFERENCE ON DECISION AND CONTROL, CDC, 2023, : 4156 - 4161