SFFL: Self-aware fairness federated learning framework for heterogeneous data distributions

被引:1
|
作者
Zhang, Jiale [1 ]
Li, Ye [2 ]
Wu, Di [3 ]
Zhao, Yanchao [2 ]
Palaiahnakote, Shivakumara [4 ]
机构
[1] Yangzhou Univ, Sch Informat Engn, Yangzhou 225009, Peoples R China
[2] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Nanjing 211106, Peoples R China
[3] Univ Southern Queensland, Sch Math Phys & Comp, Toowoomba 4350, Australia
[4] Univ Salford, Sch Sci Engn & Environm, Salford, England
基金
中国博士后科学基金;
关键词
Federated learning; Fairness machine learning; Heterogeneous distributions;
D O I
10.1016/j.eswa.2025.126418
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Federated Learning (FL) has been proven to show biased predictions against certain demographic groups, such as sex or race. Recent advances in improving fairness in federated learning come with the price of leaking sensitive information and compromising the model performance, especially under heterogeneous data distributions, which is amore practical situation for federated learning. Therefore, how to ensure the clients obtain a fair model while preserving their information privacy is anew challenge. To address it, we propose SFFL, a self-aware fairness federated learning framework that jointly improves fairness and performance under heterogeneous data distributions without the requirement for clients' sensitive information. Specifically, SFFL first introduces a fair local training algorithm, FairEM, which decomposes the clients' training objectives into fair training objects based on underlying distributions to improve local fairness and model performance. Compared to existing methods, FairEM alleviates the decrease in fairness and performance caused by inconsistent update objectives. Moreover, we further propose a self-aware aggregation method to mitigate bias propagation during aggregation, which leverages a distance-based reweighting strategy to update the aggregation weights for each client. This method discards the requirement for clients' sensitive information and maintains high effectiveness. Extensive evaluation results demonstrate that our proposed framework can significantly improve the performance decrease under heterogeneous data distributions and enhance the privacy of clients. Numerically, our proposed SFFL improves the fairness for 0.3x to 2.1x in fairness and 2.36% to 9.87% in performance compared with the existing four SOTA works.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Learning to Play With Intrinsically-Motivated, Self-Aware Agents
    Haber, Nick
    Mrowca, Damian
    Wang, Stephanie
    Li Fei-Fei
    Yamins, Daniel L. K.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [42] Heterogeneous fairness algorithm based on federated learning in intelligent transportation system
    Jiang, Yue
    Xu, Gaochao
    Fang, Zhiyi
    Song, Shinan
    Li, Bingbing
    JOURNAL OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING, 2021, 21 (05) : 1365 - 1373
  • [43] Data Quality Aware Hierarchical Federated Reinforcement Learning Framework for Dynamic Treatment Regimes
    Li, Mingyi
    Zhang, Xiao
    Ying, Haochao
    Li, Yang
    Han, Xu
    Yu, Dongxiao
    23RD IEEE INTERNATIONAL CONFERENCE ON DATA MINING, ICDM 2023, 2023, : 1103 - 1108
  • [44] Data Distribution-Aware Online Client Selection Algorithm for Federated Learning in Heterogeneous Networks
    Lee, Jaewook
    Ko, Haneul
    Seo, Sangwon
    Pack, Sangheon
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (01) : 1127 - 1136
  • [45] Data Distribution-Aware Model Aggregation for non-IID Data in a Federated Learning Framework
    Kushwaha, Deepali
    Mehrotra, Ananya
    Hegde, Rajesh M.
    PROCEEDINGS OF 2024 IEEE/IFIP NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM, NOMS 2024, 2024,
  • [46] FedCLS: Class-Aware Federated Learning in a Heterogeneous Environment
    Bhatti, Dost Muhammad Saqib
    Nam, Haewoon
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2023, 20 (02): : 1517 - 1528
  • [47] Self-Aware SGD: Reliable Incremental Adaptation Framework for Clinical AI Models
    Thakur, Anshul
    Armstrong, Jacob
    Youssef, Alexey
    Eyre, David
    Clifton, David A.
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (03) : 1624 - 1634
  • [48] Federated Imitation Learning: A Novel Framework for Cloud Robotic Systems With Heterogeneous Sensor Data
    Liu, Boyi
    Wang, Lujia
    Liu, Ming
    Xu, Cheng-Zhong
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (02) : 3509 - 3516
  • [49] FedLaw: Value-Aware Federated Learning With Individual Fairness and Coalition Stability
    Lu, Jianfeng
    Zhang, Hangjian
    Zhou, Pan
    Wang, Xiong
    Wang, Chen
    Wu, Dapeng Oliver
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2025, 9 (01): : 1049 - 1062
  • [50] A Novel Framework for the Analysis and Design of Heterogeneous Federated Learning
    Wang, Jianyu
    Liu, Qinghua
    Liang, Hao
    Gauri, Joshi
    Poor, H. Vincent
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2021, 69 : 5234 - 5249