Distributed Optimization Over Dependent Random Networks

被引:1
|
作者
Aghajan, Adel [1 ]
Touri, Behrouz [2 ]
机构
[1] Univ Calif Santa Barbara, Dept Elect & Comp Engn, Santa Barbara, CA 93106 USA
[2] Univ Calif San Diego, Dept Elect & Comp Engn, San Diego, CA 92093 USA
关键词
Convex optimization; directed graph; distributed optimization; random networks; spanning tree; PROJECTION ALGORITHMS; PARAMETER-ESTIMATION; CONSENSUS; CONVERGENCE;
D O I
10.1109/TAC.2022.3216970
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We study the averaging-based distributed optimization solvers over random networks. We show a general result on the convergence of such schemes using weight matrices that are row-stochastic almost surely and column-stochastic in expectation for a broad class of dependent weight-matrix sequences. In addition to implying many of the previously known results on this domain, our work shows the robustness of distributed optimization results to link failure. Also, it provides a new tool for synthesizing distributed optimization algorithms. To prove our main theorem, we establish new results on the rate of convergence analysis of averaging dynamics over (dependent) random networks. These secondary results, along with the required martingale-type results to establish them, might be of interest to broader research endeavors in distributed computation over random networks.
引用
收藏
页码:4812 / 4826
页数:15
相关论文
共 50 条
  • [41] Hybrid Distributed Optimization for Learning Over Networks With Heterogeneous Agents
    Nassralla, Mohammad H.
    Akl, Naeem
    Dawy, Zaher
    IEEE ACCESS, 2023, 11 : 103530 - 103543
  • [42] A dual approach for optimal algorithms in distributed optimization over networks
    Uribe, Cesar A.
    Lee, Soomin
    Gasnikov, Alexander
    Nedic, Angelia
    OPTIMIZATION METHODS & SOFTWARE, 2021, 36 (01): : 171 - 210
  • [43] A Dual Approach for Optimal Algorithms in Distributed Optimization over Networks
    Uribe, Cesar A.
    Lee, Soomin
    Gasnikov, Alexander
    Nedic, Angelia
    2020 INFORMATION THEORY AND APPLICATIONS WORKSHOP (ITA), 2020,
  • [44] Diffusion Adaptation Strategies for Distributed Optimization and Learning Over Networks
    Chen, Jianshu
    Sayed, Ali H.
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2012, 60 (08) : 4289 - 4305
  • [45] Distributed Random-Fixed Projected Algorithm for Constrained Optimization Over Digraphs
    Xie, Pei
    You, Keyou
    Song, Shiji
    Wu, Cheng
    IFAC PAPERSONLINE, 2017, 50 (01): : 14436 - 14441
  • [46] Ascending Runs in Dependent Uniformly Distributed Random Variables: Application to Wireless Networks
    Nathalie Mitton
    Katy Paroux
    Bruno Sericola
    Sébastien Tixeuil
    Methodology and Computing in Applied Probability, 2010, 12 : 51 - 62
  • [47] Ascending Runs in Dependent Uniformly Distributed Random Variables: Application to Wireless Networks
    Mitton, Nathalie
    Paroux, Katy
    Sericola, Bruno
    Tixeuil, Sebastien
    METHODOLOGY AND COMPUTING IN APPLIED PROBABILITY, 2010, 12 (01) : 51 - 62
  • [48] Inaccuracy Rates for Distributed Inference Over Random Networks With Applications to Social Learning
    Bajovic, Dragana
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2024, 70 (01) : 415 - 435
  • [49] Diffusion Scheme of Distributed EM Algorithm for Gaussian Mixtures over Random Networks
    Weng, Yang
    Xie, Lihua
    Xiao, Wendong
    2009 IEEE INTERNATIONAL CONFERENCE ON CONTROL AND AUTOMATION, VOLS 1-3, 2009, : 1529 - +
  • [50] Distributed Kalman Filtering Over Sensor Networks With Unknown Random Link Failures
    Battilotti, Stefano
    Cacace, Filippo
    d'Angelo, Massimiliano
    Germani, Alfredo
    IEEE CONTROL SYSTEMS LETTERS, 2018, 2 (04): : 587 - 592