FEDMBP: MULTI-BRANCH PROTOTYPE FEDERATED LEARNING ON HETEROGENEOUS DATA

被引:0
|
作者
Gao, Tianrun [1 ]
Liu, Xiaohong [2 ]
Yang, Yuning [1 ]
Wang, Guangyu [1 ]
机构
[1] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing, Peoples R China
[2] UCL, UCL Canc Inst, London, England
基金
中国国家自然科学基金;
关键词
Federated learning; Data heterogeneity; Prototype; Regularization; Medical image;
D O I
10.1109/ICIP49359.2023.10222143
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Federated learning (FL) enables collaborative model training across clients while preserving data privacy. However, FL faces the challenge of data heterogeneity, leading to biased local models that deviate from the global model during optimization. And existing FL algorithms like Federated Averaging (FedAvg) suffer from this issue. To address this problem, we propose a novel approach called multi-branch prototype federated learning (FedMBP). FedMBP creates auxiliary branches within each local model to integrate different levels of local and global prototypes, thus preventing local model drift by aligning local prototypes with global ones. We also introduce mixed cross-entropy on the auxiliary branches to effectively transfer global prototype knowledge to local models. We conduct experiments on three publicly available datasets, including natural and medical image domains. Our experiments demonstrate that FedMBP outperforms existing FL algorithms, achieving superior model performance.
引用
收藏
页码:2180 / 2184
页数:5
相关论文
共 50 条
  • [1] Personalized Federated Learning with Multi-branch Architecture
    Mori, Junki
    Yoshiyama, Tomoyuki
    Furukawa, Ryo
    Teranishi, Isamu
    [J]. 2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [2] Global prototype distillation for heterogeneous federated learning
    Wu, Shu
    Chen, Jindou
    Nie, Xueli
    Wang, Yong
    Zhou, Xiancun
    Lu, Linlin
    Peng, Wei
    Nie, Yao
    Menhaj, Waseef
    [J]. SCIENTIFIC REPORTS, 2024, 14 (01):
  • [3] Multi-Branch Supervised Learning on Semantic Segmentation
    Chen, Wenxin
    Zhang, Ting
    Zhao, Xing
    [J]. PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 6841 - 6845
  • [4] FedProto: Federated Prototype Learning across Heterogeneous Clients
    Tan, Yue
    Long, Guodong
    Liu, Lu
    Zhou, Tianyi
    Lu, Qinghua
    Jiang, Jing
    Zhang, Chengqi
    [J]. THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 8432 - 8440
  • [5] Heterogeneous Defect Prediction Based on Federated Prototype Learning
    Wang, Aili
    Yang, Linlin
    Wu, Haibin
    Iwahori, Yuji
    [J]. IEEE ACCESS, 2023, 11 : 98618 - 98632
  • [6] Enhancing Communication Efficiency and Training Time Uniformity in Federated Learning through Multi-Branch Networks and the Oort Algorithm
    Juan, Pin-Hung
    Wu, Ja-Ling
    [J]. ALGORITHMS, 2024, 17 (02)
  • [7] Multi-Branch Network for Few-shot Learning
    Ren, Kai
    Guo, Zijie
    Zhang, Zhimin
    Zhu, Rui
    Li, Xiaoxu
    [J]. PROCEEDINGS OF 2022 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2022, : 520 - 525
  • [8] Study of multi-branch structure of Universal Learning Networks
    Mabu, Shingo
    Shimada, Kaoru
    Hirasawa, Kotaro
    Hu, Jinglu
    [J]. APPLIED SOFT COMPUTING, 2009, 9 (01) : 393 - 403
  • [9] EPNET: Learning to Exit with Flexible Multi-Branch Network
    Dai, Xin
    Kong, Xiangnan
    Guo, Tian
    [J]. CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, : 235 - 244
  • [10] Collaborative Learning With a Multi-Branch Framework for Feature Enhancement
    Luan, Xiao
    Zhao, Yuanyuan
    Ou, Weihua
    Liu, Linghui
    Li, Weisheng
    Shu, Yucheng
    Geng, Hongmin
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 929 - 941