Accelerated Row-stochastic Optimization over Directed Graphs with Uncoordinated Step Sizes

被引:0
|
作者
Zhou, Kang [1 ]
Du, Zhenyuan [1 ]
Li, Huaqing [1 ]
机构
[1] Southwest Univ, Coll Elect & Informat Engn, Chongqing Key Lab Nonlinear Circuits & Intelligen, Chongqing 400715, Peoples R China
基金
中国国家自然科学基金;
关键词
DISTRIBUTED OPTIMIZATION; CONVERGENCE; ALGORITHM; ADMM;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper investigates a distributed optimization problem over a multiagent network, in which the target of agents is to collaboratively optimize the sum of all local objective functions. The case discusses that the network topology among agents is described by a strongly connected directed graph. The proposed algorithm utilizes row-stochastic weight matrices and uncoordinated step sizes. Under conditions that the objective functions are strong convex, and have Lipschitz continuous gradients, we manifest that proposed algorithm faster linearly converges to the global optimization solution than other algorithms as long as the chosen step sizes do not exceed an exact characterized upper bound. Numerical experiments are also provided to testify the theoretical analysis.
引用
收藏
页码:876 / 882
页数:7
相关论文
共 50 条
  • [1] FROSTFast row-stochastic optimization with uncoordinated step-sizes
    Xin, Ran
    Xi, Chenguang
    Khan, Usman A.
    [J]. EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2019, 2019 (1)
  • [2] FROST—Fast row-stochastic optimization with uncoordinated step-sizes
    Ran Xin
    Chenguang Xi
    Usman A. Khan
    [J]. EURASIP Journal on Advances in Signal Processing, 2019
  • [3] Linear Convergence in Optimization Over Directed Graphs With Row-Stochastic Matrices
    Xi, Chenguang
    Mai, Van Sy
    Xin, Ran
    Abed, Eyad H.
    Khan, Usman A.
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2018, 63 (10) : 3558 - 3565
  • [4] Distributed Convex Optimization with a Row-Stochastic Matrix over Directed Graphs
    Zhang, Yanan
    Lu, Qingguo
    Li, Huaqing
    Zhang, Hao
    [J]. 2017 14TH INTERNATIONAL WORKSHOP ON COMPLEX SYSTEMS AND NETWORKS (IWCSN), 2017, : 259 - 265
  • [5] A Fast Row-Stochastic Decentralized Method for Distributed Optimization Over Directed Graphs
    Ghaderyan, Diyako
    Aybat, Necdet Serhat
    Aguiar, A. Pedro
    Pereira, Fernando Lobo
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2024, 69 (01) : 275 - 289
  • [6] A distributed accelerated optimization algorithm over time-varying directed graphs with uncoordinated step-sizes
    Ran, Liang
    Wang, Chengbo
    Zheng, Lifeng
    Li, Huaqing
    Wang, Zheng
    [J]. OPTIMAL CONTROL APPLICATIONS & METHODS, 2022, 43 (04): : 1182 - 1200
  • [7] Accelerated Distributed Optimization over Directed Graphs with Row and Column-Stochastic Matrices
    Hu, Jinhui
    Zhu, Yifan
    Li, Huaqing
    Wang, Zheng
    [J]. 2019 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2019), 2019, : 1299 - 1305
  • [8] Decentralized stochastic optimization algorithms using uncoordinated step-sizes over unbalanced directed networks
    Hu, Jinhui
    Ran, Liang
    Du, Zhenyuan
    Li, Huaqing
    [J]. SIGNAL PROCESSING, 2021, 180
  • [9] Nash Equilibrium Seeking Over Digraphs With Row-Stochastic Matrices and Network-Independent Step-Sizes
    Nguyen, Duong Thuy Anh
    Bianchi, Mattia
    Dorfler, Florian
    Nguyen, Duong Tung
    Nedic, Angelia
    [J]. IEEE CONTROL SYSTEMS LETTERS, 2023, 7 : 3543 - 3548
  • [10] Distributed Optimization over Weighted Directed Graphs using Row Stochastic Matrix
    Mai, Van Sy
    Abed, Eyad H.
    [J]. 2016 AMERICAN CONTROL CONFERENCE (ACC), 2016, : 7165 - 7170