Analysis of distributed ADMM algorithm for consensus optimisation over lossy networks

被引:7
|
作者
Majzoobi, Layla [1 ]
Shah-Mansouri, Vahid [1 ]
Lahouti, Farshad [1 ,2 ]
机构
[1] Univ Tehran, Sch Elect & Comp Engn, Tehran, Iran
[2] CALTECH, Dept Elect Engn, Pasadena, CA 91125 USA
关键词
computational complexity; convex programming; distributed algorithms; distributed ADMM algorithm; lossy network; consensus optimisation problem; network connectivity; alternating direction method of multipliers; convex optimisation algorithm; computational resource requirements; storage requirements; ALTERNATING DIRECTION METHOD; CONVERGENCE RATE;
D O I
10.1049/iet-spr.2018.0033
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Alternating direction method of multipliers (ADMM) is a popular convex optimisation algorithm, which is implemented in a distributed manner. Applying this algorithm to consensus optimisation problem, where a number of agents cooperatively try to solve an optimisation problem using locally available data, leads to a fully distributed algorithm which relies on local computations and communication between neighbours. In this study, the authors analyse the convergence of the distributed ADMM algorithm for solving a consensus optimisation problem over a lossy network, whose links are subject to failure. They present and analyse two different distributed ADMM-based algorithms. The algorithms are different in their network connectivity, storage and computational resource requirements. The first one converges over a sequence of networks which are not the same but remains connected over all iterations. The second algorithm is convergent over a sequence of different networks whose union is connected. The former algorithm, compared to the latter, has lower computational complexity and storage requirements. Numerical experiments confirm the proposed theoretical analysis.
引用
收藏
页码:786 / 794
页数:9
相关论文
共 50 条
  • [1] ANALYSIS OF DISTRIBUTED ADMM ALGORITHM FOR CONSENSUS OPTIMIZATION IN PRESENCE OF ERROR
    Majzoobi, Layla
    Lahouti, Farshad
    2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 4831 - 4835
  • [2] Analysis of Distributed ADMM Algorithm for Consensus Optimization in Presence of Node Error
    Majzoobi, Layla
    Lahouti, Farshad
    Shah-Mansouri, Vahid
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2019, 67 (07) : 1774 - 1784
  • [3] Asynchronous Distributed Optimization Over Lossy Networks via Relaxed ADMM: Stability and Linear Convergence
    Bastianello, Nicola
    Carli, Ruggero
    Schenato, Luca
    Todescato, Marco
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2021, 66 (06) : 2620 - 2635
  • [4] A Partition-Based Implementation of the Relaxed ADMM for Distributed Convex Optimization over Lossy Networks
    Bastianello, N.
    Carli, R.
    Schenato, L.
    Todescato, M.
    2018 IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2018, : 3379 - 3384
  • [5] Relaxed hybrid consensus ADMM for distributed convex optimisation with coupling constraints
    Olama, Alireza
    Bastianello, Nicola
    Mendes, Paulo R. C.
    Camponogara, Eduardo
    IET CONTROL THEORY AND APPLICATIONS, 2019, 13 (17): : 2828 - 2837
  • [6] Finite-time convergent distributed consensus optimisation over networks
    Song, Yanfei
    Chen, Weisheng
    IET CONTROL THEORY AND APPLICATIONS, 2016, 10 (11): : 1314 - 1318
  • [7] Convergence Rate of Distributed ADMM Over Networks
    Makhdoumi, Ali
    Ozdaglar, Asuman
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2017, 62 (10) : 5082 - 5095
  • [8] ADMM for Dynamic Average Consensus over Imperfect Networks
    Bastianello, Nicola
    Carli, Ruggero
    IFAC PAPERSONLINE, 2022, 55 (13): : 228 - 233
  • [9] Distributed Optimization over Lossy Networks via Relaxed Peaceman-Rachford Splitting: a Robust ADMM Approach
    Bastianello, N.
    Todescato, M.
    Carli, R.
    Schenato, L.
    2018 EUROPEAN CONTROL CONFERENCE (ECC), 2018, : 478 - 483
  • [10] A Zeroth-Order ADMM Algorithm for Stochastic Optimization over Distributed Processing Networks
    Shi, Zai
    Eryilmaz, Atilla
    IEEE INFOCOM 2020 - IEEE CONFERENCE ON COMPUTER COMMUNICATIONS, 2020, : 726 - 735