Distributed cooperative learning over time-varying random networks using a gossip-based communication protocol

被引:1
|
作者
Ren, Pengfei [1 ]
Dai, Hao [1 ]
Chen, Weisheng [1 ]
机构
[1] Xidian Univ, Sch Aerosp Sci & Technol, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Machine learning; Distributed cooperative learning (DCL); Consensus; Gossip-based communication protocol; Fuzzy logic systems; LEAST-MEAN SQUARES; DIFFUSION LMS; APPROXIMATION-THEORY; ADAPTIVE NETWORKS; NEURAL-NETWORK; FUZZY-SYSTEMS; BIG DATA; ALGORITHM; CLASSIFIERS; CHALLENGES;
D O I
10.1016/j.fss.2019.05.009
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Motivated by applications of distributed estimation and distributed decision making in wireless sensor networks (WSNs) and unmanned aerial vehicle (UAV) networks, we study a distributed learning problem over time-varying undirected random networks. Using a gossip-based communication protocol, a novel distributed cooperative learning (DCL) algorithm, termed the gossip-based DCL (GBDCL) algorithm, is presented to solve the problem by training the raw data distributed and blocked throughout different nodes. Exploiting the robustness of the gossip-based protocol, each node is guaranteed to build the same learning model in theory against random disconnections and communication route variations in the network topology. It is proved that the GBDCL algorithm converges to the optimal consensus asymptotically. The correctness and effectiveness of the presented GBDCL algorithm are verified in the theoretical analysis and simulations. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:124 / 145
页数:22
相关论文
共 50 条
  • [1] Gossip-based Distributed Filtering Over Networks Using Projection
    Wan, Chao
    Gao, Yongxin
    Li, X. Rong
    [J]. 2019 22ND INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION 2019), 2019,
  • [2] Asynchronous Gossip-Based Random Projection Algorithms Over Networks
    Lee, Soomin
    Nedic, Angelia
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2016, 61 (04) : 953 - 968
  • [3] Decentralized Gossip-Based Stochastic Bilevel Optimization over Communication Networks
    Yang, Shuoguang
    Zhang, Xuezhou
    Wang, Mengdi
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [4] Microgrid Distributed Frequency Control Over Time-Varying Communication Networks
    Zholbaryssov, Madi
    Dominguez-Garcia, Alejandro D.
    [J]. 2018 IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2018, : 5722 - 5727
  • [5] Distributed ADMM for Time-Varying Communication Networks
    Tian, Zhuojun
    Zhang, Zhaoyang
    Jin, Richeng
    [J]. 2022 IEEE 96TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-FALL), 2022,
  • [6] Distributed adaptive clustering learning over time-varying multitask networks
    Shi, Qing
    Chen, Feng
    Li, Xinyu
    Duan, Shukai
    [J]. INFORMATION SCIENCES, 2021, 567 : 278 - 297
  • [7] Fast Coordination of Distributed Energy Resources Over Time-Varying Communication Networks
    Zholbaryssov, Madi
    Hadjicostis, Christoforos N.
    Dominguez-Garcia, Alejandro D.
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2023, 68 (02) : 1023 - 1038
  • [8] Distributed Energy Resource Coordination Over Time-Varying Directed Communication Networks
    Yang, Tao
    Wu, Di
    Fang, Huazhen
    Ren, Wei
    Wang, Hong
    Hong, Yiguang
    Johansson, Karl Henrik
    [J]. IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2019, 6 (03): : 1124 - 1134
  • [9] A Gossip-Based Distributed Algorithm for Economic Dispatch in Smart Grids With Random Communication Link Failures
    Wang, Rui
    Li, Qiqiang
    Li, Guanguan
    Liu, Huimin
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2020, 67 (06) : 4635 - 4645
  • [10] Random Sleep Scheme-Based Distributed Optimization Algorithm Over Unbalanced Time-Varying Networks
    Li, Huaqing
    Wang, Zheng
    Xia, Dawen
    Han, Qi
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (08): : 5244 - 5253