Multi-Granularity Federated Learning by Graph-Partitioning

被引:0
|
作者
Dai, Ziming [1 ,2 ]
Zhao, Yunfeng [1 ]
Qiu, Chao [1 ,2 ]
Wang, Xiaofei [1 ,2 ]
Yao, Haipeng [3 ]
Niyato, Dusit [4 ]
机构
[1] Tianjin University, College of Intelligence and Computing, Tianjin,300072, China
[2] Guangdong Laboratory of Artificial Intelligence and Digital Economy, Shenzhen,518000, China
[3] Beijing University of Posts and Telecommunications, Information and Communication Engineering, Beijing,100876, China
[4] Nanyang Technological University, College of Computing and Data Science, Singapore,639798, Singapore
来源
IEEE Transactions on Cloud Computing | 2025年 / 13卷 / 01期
基金
新加坡国家研究基金会; 中国国家自然科学基金;
关键词
Adversarial machine learning - Contrastive Learning;
D O I
10.1109/TCC.2024.3494765
中图分类号
学科分类号
摘要
In edge computing, energy-limited distributed edge clients present challenges such as heterogeneity, high energy consumption, and security risks. Traditional blockchain-based federated learning (BFL) struggles to address all three of these challenges simultaneously. This article proposes a Graph-Partitioning Multi-Granularity Federated Learning method on a consortium blockchain, namely GP-MGFL. To reduce the overall communication overhead, we adopt a balanced graph partitioning algorithm while introducing observer and consensus nodes. This method groups clients to minimize high-cost communications and focuses on the guidance effect within each group, thereby ensuring effective guidance with reduced overhead. To fully leverage heterogeneity, we introduce a cross-granularity guidance mechanism. This mechanism involves fine-granularity models guiding coarse-granularity models to enhance the accuracy of the latter models. We also introduce a credit model to adjust the contribution of models to the global model dynamically and to dynamically select leaders responsible for model aggregation. Finally, we implement a prototype system on real physical hardware and compare it with several baselines. Experimental results show that the accuracy of the GP-MGFL algorithm is 5.6% higher than that of ordinary BFL algorithms. In addition, compared to other grouping methods, such as greedy grouping, the accuracy of the proposed method improves by about 1.5%. In scenarios with malicious clients, the maximum accuracy improvement reaches 11.1%. We also analyze and summarize the impact of grouping and the number of clients on the model, as well as the impact of this method on the inherent security of the blockchain itself. © 2013 IEEE.
引用
下载
收藏
页码:18 / 33
相关论文
共 50 条
  • [21] Multi-granularity heterogeneous graph attention networks for extractive document summarization
    Zhao, Yu
    Wang, Leilei
    Wang, Cui
    Du, Huaming
    Wei, Shaopeng
    Feng, Huali
    Yu, Zongjian
    Li, Qing
    NEURAL NETWORKS, 2022, 155 : 340 - 347
  • [22] Multi-Granularity Graph Convolution Network for Major Depressive Disorder Recognition
    Sun, Xiaofang
    Xu, Yonghui
    Zhao, Yibowen
    Zheng, Xiangwei
    Cui, Lizhen
    Zheng, Yongqing
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2024, 32 : 559 - 569
  • [23] A multi-granularity grid-based graph model for indoor space
    1600, Science and Engineering Research Support Society (09):
  • [24] Multi-granularity Histories Merging Network for Temporal Knowledge Graph Reasoning
    Liu, Shihao
    Zhou, Xiaofei
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT XIII, ICIC 2024, 2024, 14874 : 158 - 169
  • [25] Multi-Granularity Decomposition for Componentized Multimedia Applications based on Graph Clustering
    Wang, Ziliang
    Zhou, Fanqin
    Feng, Lei
    Li, Wenjing
    2021 IEEE INTERNATIONAL SYMPOSIUM ON BROADBAND MULTIMEDIA SYSTEMS AND BROADCASTING (BMSB), 2021,
  • [26] MULTI-GRANULARITY HETEROGENEOUS GRAPH FOR DOCUMENT-LEVEL RELATION EXTRACTION
    Tang, Hengzhu
    Cao, Yanan
    Zhang, Zhenyu
    Jia, Ruipeng
    Fang, Fang
    Wang, Shi
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 7683 - 7687
  • [27] Fine-Grained Video Captioning via Graph-based Multi-Granularity Interaction Learning
    Yan, Yichao
    Zhuang, Ning
    Ni, Bingbing
    Zhang, Jian
    Xu, Minghao
    Zhang, Qiang
    Zheng, Zhang
    Cheng, Shuo
    Tian, Qi
    Xu, Yi
    Yang, Xiaokang
    Zhang, Wenjun
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (02) : 666 - 683
  • [28] Multi-granularity Histories Merging Network for Temporal Knowledge Graph Reasoning
    Liu, Shihao
    Zhou, Xiaofei
    Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2024, 14874 LNCS : 158 - 169
  • [29] Which Matters Most in Making Fund Investment Decisions? A Multi-granularity Graph Disentangled Learning Framework
    Gan, Chunjing
    Hu, Binbin
    Huang, Bo
    Zhao, Tianyu
    Lin, Yingru
    Zhong, Wenliang
    Zhang, Zhiqiang
    Zhou, Jun
    Shi, Chuan
    PROCEEDINGS OF THE 46TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2023, 2023, : 2516 - 2520
  • [30] Multi-granularity Signal Processing Method for Digital Twin Power Grids via Graph Representation Learning
    Han, Jinglin
    Feng, Xichun
    Zhao, Hui
    Chen, Zhiyong
    Hu, Ping
    TRAITEMENT DU SIGNAL, 2024, 41 (03) : 1263 - 1270