SFFL: Self-aware fairness federated learning framework for heterogeneous data distributions

被引:1
|
作者
Zhang, Jiale [1 ]
Li, Ye [2 ]
Wu, Di [3 ]
Zhao, Yanchao [2 ]
Palaiahnakote, Shivakumara [4 ]
机构
[1] Yangzhou Univ, Sch Informat Engn, Yangzhou 225009, Peoples R China
[2] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Nanjing 211106, Peoples R China
[3] Univ Southern Queensland, Sch Math Phys & Comp, Toowoomba 4350, Australia
[4] Univ Salford, Sch Sci Engn & Environm, Salford, England
基金
中国博士后科学基金;
关键词
Federated learning; Fairness machine learning; Heterogeneous distributions;
D O I
10.1016/j.eswa.2025.126418
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Federated Learning (FL) has been proven to show biased predictions against certain demographic groups, such as sex or race. Recent advances in improving fairness in federated learning come with the price of leaking sensitive information and compromising the model performance, especially under heterogeneous data distributions, which is amore practical situation for federated learning. Therefore, how to ensure the clients obtain a fair model while preserving their information privacy is anew challenge. To address it, we propose SFFL, a self-aware fairness federated learning framework that jointly improves fairness and performance under heterogeneous data distributions without the requirement for clients' sensitive information. Specifically, SFFL first introduces a fair local training algorithm, FairEM, which decomposes the clients' training objectives into fair training objects based on underlying distributions to improve local fairness and model performance. Compared to existing methods, FairEM alleviates the decrease in fairness and performance caused by inconsistent update objectives. Moreover, we further propose a self-aware aggregation method to mitigate bias propagation during aggregation, which leverages a distance-based reweighting strategy to update the aggregation weights for each client. This method discards the requirement for clients' sensitive information and maintains high effectiveness. Extensive evaluation results demonstrate that our proposed framework can significantly improve the performance decrease under heterogeneous data distributions and enhance the privacy of clients. Numerically, our proposed SFFL improves the fairness for 0.3x to 2.1x in fairness and 2.36% to 9.87% in performance compared with the existing four SOTA works.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Self-Aware Personalized Federated Learning
    Chen, Huili
    Ding, Jie
    Tramel, Eric
    Wu, Shuang
    Sahu, Anit Kumar
    Avestimehr, Salman
    Zhang, Tao
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [2] Self-aware distributed deep learning framework for heterogeneous IoT edge devices
    Jin, Yi
    Cai, Jiawei
    Xu, Jiawei
    Huan, Yuxiang
    Yan, Yulong
    Huang, Bin
    Guo, Yongliang
    Zheng, Lirong
    Zou, Zhuo
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2021, 125 : 908 - 920
  • [3] Knows what it knows: a framework for self-aware learning
    Lihong Li
    Michael L. Littman
    Thomas J. Walsh
    Alexander L. Strehl
    Machine Learning, 2011, 82 : 399 - 443
  • [4] Knows what it knows: a framework for self-aware learning
    Li, Lihong
    Littman, Michael L.
    Walsh, Thomas J.
    Strehl, Alexander L.
    MACHINE LEARNING, 2011, 82 (03) : 399 - 443
  • [5] Self-aware and learning structure
    Adam, Bernard
    Smith, Ian F. C.
    INTELLIGENT COMPUTING IN ENGINEERING AND ARCHITECTURE, 2006, 4200 : 7 - 14
  • [6] Towards Fairness-Aware Federated Learning
    Shi, Yuxin
    Yu, Han
    Leung, Cyril
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (09) : 11922 - 11938
  • [7] A Self-aware Resource Management Framework for Heterogeneous Multicore SoCs with Diverse QoS Targets
    Song, Yang
    Alavoine, Olivier
    Lin, Bill
    ACM TRANSACTIONS ON ARCHITECTURE AND CODE OPTIMIZATION, 2019, 16 (02)
  • [8] Federated Learning Algorithms with Heterogeneous Data Distributions: An Empirical Evaluation
    Mora, Alessio
    Fantini, Davide
    Bellavista, Paolo
    2022 IEEE/ACM 7TH SYMPOSIUM ON EDGE COMPUTING (SEC 2022), 2022, : 336 - 341
  • [9] SURF: Self-aware Unified Runtime Framework for Parallel Programs on Heterogeneous Mobile Architectures
    Hsieh, Chenying
    Sani, Ardalan Amiri
    Dutt, Nikil
    2019 IFIP/IEEE 27TH INTERNATIONAL CONFERENCE ON VERY LARGE SCALE INTEGRATION (VLSI-SOC), 2019, : 136 - 141
  • [10] The potential of federated learning for self-configuring medical object detection in heterogeneous data distributions
    Rashidi, Gabriel
    Bounias, Dimitrios
    Bujotzek, Markus
    Mora, Andres Martinez
    Neher, Peter
    Maier-Hein, Klaus H.
    SCIENTIFIC REPORTS, 2024, 14 (01):