Privacy-Enhanced Federated Learning for Non-IID Data

被引:0
|
作者
Tan, Qingjie [1 ]
Wu, Shuhui [1 ]
Tao, Yuanhong [1 ]
机构
[1] Zhejiang Univ Sci & Technol, Sch Sci, Hangzhou 310023, Peoples R China
关键词
federated learning; Hellinger distance; differential privacy; non-IID data; 68CS; 94ICC;
D O I
10.3390/math11194123
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Federated learning (FL) allows the collaborative training of a collective model by a vast number of decentralized clients while ensuring that these clients' data remain private and are not shared. In practical situations, the training data utilized in FL often exhibit non-IID characteristics, hence diminishing the efficacy of FL. Our study presents a novel privacy-preserving FL algorithm, HW-DPFL, which leverages data label distribution similarity as a basis for its design. Our proposed approach achieves this objective without incurring any additional overhead communication. In this study, we provide evidence to support the assertion that our approach improves the privacy guarantee and convergence of FL both theoretically and empirically.
引用
收藏
页数:21
相关论文
共 50 条
  • [31] FEDERATED PAC-BAYESIAN LEARNING ON NON-IID DATA
    Zhao, Zihao
    Liu, Yang
    Ding, Wenbo
    Zhang, Xiao-Ping
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 5945 - 5949
  • [32] A General Federated Learning Scheme with Blockchain on Non-IID Data
    Wu, Hao
    Zhao, Shengnan
    Zhao, Chuan
    Jing, Shan
    INFORMATION SECURITY AND CRYPTOLOGY, INSCRYPT 2023, PT I, 2024, 14526 : 126 - 140
  • [33] FedProc: Prototypical contrastive federated learning on non-IID data
    Mu, Xutong
    Shen, Yulong
    Cheng, Ke
    Geng, Xueli
    Fu, Jiaxuan
    Zhang, Tao
    Zhang, Zhiwei
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2023, 143 : 93 - 104
  • [34] Data independent warmup scheme for non-IID federated learning
    Arafeh, Mohamad
    Ould-Slimane, Hakima
    Otrok, Hadi
    Mourad, Azzam
    Talhi, Chamseddine
    Damiani, Ernesto
    INFORMATION SCIENCES, 2023, 623 : 342 - 360
  • [35] FedPD: A Federated Learning Framework With Adaptivity to Non-IID Data
    Zhang, Xinwei
    Hong, Mingyi
    Dhople, Sairaj
    Yin, Wotao
    Liu, Yang
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2021, 69 (69) : 6055 - 6070
  • [36] FedCML: Federated Clustering Mutual Learning with non-IID Data
    Chen, Zekai
    Wang, Fuyi
    Yu, Shengxing
    Liu, Ximeng
    Zheng, Zhiwei
    EURO-PAR 2023: PARALLEL PROCESSING, 2023, 14100 : 623 - 636
  • [37] Heterogeneous Federated Learning for Non-IID Smartwatch Data Classification
    Syu, Jia-Hao
    Lin, Jerry Chun-Wei
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (18): : 29811 - 29818
  • [38] Ensemble Federated Learning With Non-IID Data in Wireless Networks
    Zhao, Zhongyuan
    Wang, Jingyi
    Hong, Wei
    Quek, Tony Q. S.
    Ding, Zhiguo
    Peng, Mugen
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (04) : 3557 - 3571
  • [39] Advanced Optimization Techniques for Federated Learning on Non-IID Data
    Efthymiadis, Filippos
    Karras, Aristeidis
    Karras, Christos
    Sioutas, Spyros
    FUTURE INTERNET, 2024, 16 (10)
  • [40] Feature Matching Data Synthesis for Non-IID Federated Learning
    Li, Zijian
    Sun, Yuchang
    Shao, Jiawei
    Mao, Yuyi
    Wang, Jessie Hui
    Zhang, Jun
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (10) : 9352 - 9367