Distributed Optimization Over Dependent Random Networks

被引:1
|
作者
Aghajan, Adel [1 ]
Touri, Behrouz [2 ]
机构
[1] Univ Calif Santa Barbara, Dept Elect & Comp Engn, Santa Barbara, CA 93106 USA
[2] Univ Calif San Diego, Dept Elect & Comp Engn, San Diego, CA 92093 USA
关键词
Convex optimization; directed graph; distributed optimization; random networks; spanning tree; PROJECTION ALGORITHMS; PARAMETER-ESTIMATION; CONSENSUS; CONVERGENCE;
D O I
10.1109/TAC.2022.3216970
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We study the averaging-based distributed optimization solvers over random networks. We show a general result on the convergence of such schemes using weight matrices that are row-stochastic almost surely and column-stochastic in expectation for a broad class of dependent weight-matrix sequences. In addition to implying many of the previously known results on this domain, our work shows the robustness of distributed optimization results to link failure. Also, it provides a new tool for synthesizing distributed optimization algorithms. To prove our main theorem, we establish new results on the rate of convergence analysis of averaging dynamics over (dependent) random networks. These secondary results, along with the required martingale-type results to establish them, might be of interest to broader research endeavors in distributed computation over random networks.
引用
收藏
页码:4812 / 4826
页数:15
相关论文
共 50 条
  • [21] Distributed Zeroth Order Optimization Over Random Networks: A Kiefer-Wolfowitz Stochastic Approximation Approach
    Sahu, Anit Kumar
    Jakovetic, Dusan
    Bajovic, Dragana
    Kar, Soummya
    2018 IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2018, : 4951 - 4958
  • [22] Distributed Nonsmooth Convex Optimization over Markovian Switching Random Networks with Two Step-Sizes
    YI Peng
    LI Li
    JournalofSystemsScience&Complexity, 2021, 34 (04) : 1324 - 1344
  • [23] Convergence Analysis of Distributed Subgradient Methods over Random Networks
    Lobel, Ilan
    Ozdaglar, Asuman
    2008 46TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING, VOLS 1-3, 2008, : 353 - +
  • [24] A Fast Algorithm for Distributed Optimization over Directed Networks
    Zeng, Jinshan
    He, Tao
    2016 IEEE INTERNATIONAL CONFERENCE ON CYBER TECHNOLOGY IN AUTOMATION, CONTROL, AND INTELLIGENT SYSTEMS (CYBER), 2016, : 45 - 49
  • [25] Distributed Optimization for Generalized Phase Retrieval Over Networks
    Zhao, Ziping
    Lu, Songtao
    Hong, Mingyi
    Palomar, Daniel P.
    2018 CONFERENCE RECORD OF 52ND ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2018, : 48 - 52
  • [26] A Bregman Splitting Scheme for Distributed Optimization Over Networks
    Xu, Jinming
    Zhu, Shanying
    Soh, Yeng Chai
    Xie, Lihua
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2018, 63 (11) : 3809 - 3824
  • [27] Distributed Minimax Fair Optimization over Hierarchical Networks
    Xu, Wen
    Wang, Juncheng
    Liang, Ben
    Boudreau, Gary
    Sokun, Hamza
    53RD INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING, ICPP 2024, 2024, : 138 - 147
  • [28] ASYMPTOTIC PROPERTIES OF PRIMAL-DUAL ALGORITHM FOR DISTRIBUTED STOCHASTIC OPTIMIZATION OVER RANDOM NETWORKS WITH IMPERFECT COMMUNICATIONS
    Lei, Jinlong
    Chen, Han-Fu
    Fang, Hai-Tao
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2018, 56 (03) : 2159 - 2188
  • [29] Random Sleep Scheme-Based Distributed Optimization Algorithm Over Unbalanced Time-Varying Networks
    Li, Huaqing
    Wang, Zheng
    Xia, Dawen
    Han, Qi
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (08): : 5244 - 5253
  • [30] Distributed Multi-Agent Convex Optimization Over Random Digraphs
    Alaviani, S. Sh.
    Elia, N.
    2017 AMERICAN CONTROL CONFERENCE (ACC), 2017, : 5288 - 5293