An Asynchronous Distributed ADMM Algorithm and Efficient Communication Model

被引：7
|
作者：
Fang, Ling [1 ]
Lei, Yongmei [1 ]
机构：
[1] Shanghai Univ, Sch Comp Engn & Sci, Shanghai, Peoples R China
来源：
2016 IEEE 14TH INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, 14TH INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, 2ND INTL CONF ON BIG DATA INTELLIGENCE AND COMPUTING AND CYBER SCIENCE AND TECHNOLOGY CONGRESS (DASC/PICOM/DATACOM/CYBERSC | 2016年
关键词：
ADMM; asynchronous; hierarchical communication model; butterfly;
D O I：
10.1109/DASC-PICom-DataCom-CyberSciTec.2016.41
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
In this paper, we present a hierarchical butterfly communication model, which is applied to an asynchronous distributed ADMM algorithm. The goal is to minimize the communication overhead of the distributed ADMM algorithm in the fully connected network. We give a theoretical analysis of the convergence of the algorithm with hierarchical butterfly communication model. Experiments show that hierarchical butterfly communication model does not have a great impact on the convergence of the algorithm with the increase of computing nodes and thus effectively improve the performance and scalability of the algorithm.
引用
收藏
页码：136 / 140
页数：5
相关论文
共 50 条
  • [1] Asynchronous Distributed Optimization via ADMM with Efficient Communication
    Rikos, Apostolos, I
    Jiang, Wei
    Charalambous, Themistoklis
    Johansson, Karl H.
    [J]. 2023 62ND IEEE CONFERENCE ON DECISION AND CONTROL, CDC, 2023, : 7002 - 7008
  • [2] PSRA-HGADMM: A Communication Efficient Distributed ADMM Algorithm
    Qiu, Yongwen
    Lei, Yongmei
    Wang, Guozheng
    [J]. PROCEEDINGS OF THE 52ND INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING, ICPP 2023, 2023, : 82 - 91
  • [3] Asynchronous group-based ADMM algorithm under efficient communication structure
    Zhou, Jianhui
    Lei, Yongmei
    [J]. 2018 IEEE INT CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, UBIQUITOUS COMPUTING & COMMUNICATIONS, BIG DATA & CLOUD COMPUTING, SOCIAL COMPUTING & NETWORKING, SUSTAINABLE COMPUTING & COMMUNICATIONS, 2018, : 135 - 140
  • [4] D-ADMM: A Communication-Efficient Distributed Algorithm for Separable Optimization
    Mota, Joao F. C.
    Xavier, Joao M. F.
    Aguiar, Pedro M. Q.
    Pueschel, Markus
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2013, 61 (10) : 2718 - 2723
  • [5] GR-ADMM: A Communication Efficient Algorithm Based on ADMM
    Huang, Xin
    Wang, Guozheng
    Lei, Yongmei
    [J]. 19TH IEEE INTERNATIONAL SYMPOSIUM ON PARALLEL AND DISTRIBUTED PROCESSING WITH APPLICATIONS (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2021), 2021, : 220 - 227
  • [6] A Distributed, Asynchronous, and Incremental Algorithm for Nonconvex Optimization: An ADMM Approach
    Hong, Mingyi
    [J]. IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2018, 5 (03): : 935 - 945
  • [7] An efficient hybrid MPI/OpenMP parallelization of the asynchronous ADMM algorithm
    Qiu, Qinnan
    Lei, Yongmei
    Wang, Dongxia
    Wang, Guozheng
    [J]. 19TH IEEE INTERNATIONAL SYMPOSIUM ON PARALLEL AND DISTRIBUTED PROCESSING WITH APPLICATIONS (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2021), 2021, : 563 - 570
  • [8] Asynchronous Distributed ADMM for Consensus Optimization
    Zhang, Ruiliang
    Kwok, James T.
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 32 (CYCLE 2), 2014, 32 : 1701 - 1709
  • [9] Impact of Communication Delay on Asynchronous Distributed Optimal Power Flow Using ADMM
    Guo, Junyao
    Hug, Gabriela
    Tonguz, Ozan
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON SMART GRID COMMUNICATIONS (SMARTGRIDCOMM), 2017, : 177 - 182
  • [10] Local Stochastic ADMM for Communication-Efficient Distributed Learning
    ben Issaid, Chaouki
    Elgabli, Anis
    Bennis, Mehdi
    [J]. 2022 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2022, : 1880 - 1885
12345