Federated Learning Under Heterogeneous and Correlated Client Availability

被引:0
|
作者
Rodio, Angelo [1 ]
Faticanti, Francescomaria [1 ]
Marfoq, Othmane [2 ]
Neglia, Giovanni [1 ,3 ]
Leonardi, Emilio [4 ]
机构
[1] Ctr Inria Univ Cote Azur, Inria, F-06902 Valbonne, France
[2] Ctr Inria Univ Cote Azur, F-06902 Valbonne, France
[3] Accenture Labs, F-06410 Biot, France
[4] Politecn Torino, DET, I-10129 Turin, Italy
关键词
Federated learning; correlated client availability; Markov chains;
D O I
10.1109/TNET.2023.3324257
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In Federated Learning (FL), devices - also referred to as clients - can exhibit heterogeneous availability patterns, often correlated over time and with other clients. This paper addresses the problem of heterogeneous and correlated client availability in FL. Our theoretical analysis is the first to demonstrate the negative impact of correlation on FL algorithms' convergence rate and highlights a trade-off between optimization error (related to convergence speed) and bias error (indicative of model quality). To optimize this trade-off, we propose Correlation-Aware FL (), a novel algorithm that dynamically balances the competing objectives of fast convergence and minimal model bias. achieves this by dynamically adjusting the aggregation weight assigned to each client and selectively excluding clients with high temporal correlation and low availability. Experimental evaluations on diverse datasets demonstrate the effectiveness of compared to state-of-the-art methods. Specifically, achieves the best trade-off between training time and test accuracy. By dynamically handling clients with high temporal correlation and low availability, emerges as a promising solution to mitigate the detrimental impact of correlated client availability in FL.
引用
收藏
页码:1451 / 1460
页数:10
相关论文
共 50 条
  • [1] Federated Learning with Client Availability Budgets
    Bao, Yunkai
    Drew, Steve
    Wang, Xin
    Zhou, Jiayu
    Niu, Xiaoguang
    [J]. IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 1902 - 1907
  • [2] Federated Optimization Under Intermittent Client Availability
    Yan, Yikai
    Niu, Chaoyue
    Ding, Yucheng
    Zheng, Zhenzhe
    Tang, Shaojie
    Li, Qinya
    Wu, Fan
    Lyu, Chengfei
    Feng, Yanghe
    Chen, Guihai
    [J]. INFORMS JOURNAL ON COMPUTING, 2024, 36 (01) : 185 - 202
  • [3] Federated Learning Under Intermittent Client Availability and Time-Varying Communication Constraints
    Ribero, Monica
    Vikalo, Haris
    de Veciana, Gustavo
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2023, 17 (01) : 98 - 111
  • [4] An Incentive Auction for Heterogeneous Client Selection in Federated Learning
    Pang, Jinlong
    Yu, Jieling
    Zhou, Ruiting
    Lui, John C. S.
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (10) : 5733 - 5750
  • [5] Fast Heterogeneous Federated Learning with Hybrid Client Selection
    Song, Duanxiao
    Shen, Guangyuan
    Gao, Dehong
    Yang, Libin
    Zhou, Xukai
    Pan, Shirui
    Lou, Wei
    Zhou, Fang
    [J]. UNCERTAINTY IN ARTIFICIAL INTELLIGENCE, 2023, 216 : 2006 - 2015
  • [6] Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge
    Nishio, Takayuki
    Yonetani, Ryo
    [J]. ICC 2019 - 2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2019,
  • [7] Optimal Mechanism Design for Heterogeneous Client Sampling in Federated Learning
    Liao, Guocheng
    Luo, Bing
    Feng, Yutong
    Zhang, Meng
    Chen, Xu
    [J]. IEEE Transactions on Mobile Computing, 2024, 23 (11) : 10598 - 10609
  • [8] Adaptive client selection and model aggregation for heterogeneous federated learning
    Zhai, Rui
    Jin, Haozhe
    Gong, Wei
    Lu, Ke
    Liu, Yanhong
    Song, Yalin
    Yu, Junyang
    [J]. MULTIMEDIA SYSTEMS, 2024, 30 (04)
  • [9] Communication Efficient Federated Learning With Heterogeneous Structured Client Models
    Hu, Yao
    Sun, Xiaoyan
    Tian, Ye
    Song, Linqi
    Tan, Kay Chen
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2023, 7 (03): : 753 - 767
  • [10] Federated Learning With Heterogeneous Client Expectations: A Game Theory Approach
    Shen, Sheng
    Liu, Chi
    Lim, Teng Joon
    [J]. IEEE Transactions on Knowledge and Data Engineering, 2024, 36 (12) : 8220 - 8237