Mitigating data imbalance and generating better prototypes in heterogeneous Federated Graph Learning

被引:2
|
作者
Kong, Xiangjie [1 ]
Yuan, Haopeng [1 ]
Shen, Guojiang [1 ]
Zhou, Hanlin [1 ]
Liu, Weiyao [1 ]
Yang, Yao [2 ]
机构
[1] Zhejiang Univ Technol, Hangzhou 310023, Peoples R China
[2] Zhejiang Lab, Hangzhou 311100, Peoples R China
基金
中国国家自然科学基金;
关键词
Federated graph learning; Heterogeneity; Data enhancement; Prototype;
D O I
10.1016/j.knosys.2024.111876
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Federated Graph Learning (FGL) opens up new possibilities for machine learning in complex networks and distributed training, enabling multiple clients to collaborate on training Graph Neural Networks (GNNs) while preserving privacy. However, there may be differences between participating clients in terms of data distribution, computational power, and model architecture, which requires us to be able to mitigate the problem of heterogeneity across participating clients. Most of the existing model -heterogeneous Federated Learning frameworks are based on non -graph data, which is not sufficiently effective in FGL scenarios. Moreover we find that the model -heterogeneous Federated Learning approach based on prototype learning generates a single global prototype that does not provide good guidelines for each client in the case of multiple heterogeneous clients. Also, the problem of class imbalance of local data in FGL scenarios affects the overall utility. To this end, we propose FGPL, a model heterogeneous FGL framework based on prototype learning and local data augmentation. Specifically, on the one hand, locally, we mitigate the problem of local data imbalance by generating better local prototypes through a node generation method based on global prototypes and local structures. On the other hand, we cope with the domain bias problem by generating targeted global prototypes, and use a comparative learning approach to provide more personalized and correct guidelines for each client's training. We demonstrate with extensive experiments that our approach can greatly improve the prediction of FGL.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Federated Graph Learning under Domain Shift with Generalizable Prototypes
    Wan, Guancheng
    Huang, Wenke
    Ye, Mang
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 14, 2024, : 15429 - 15437
  • [2] Mitigating Group Bias in Federated Learning for Heterogeneous Devices
    Selialia, Khotso
    Chandio, Yasra
    Anwar, Fatima M.
    [J]. PROCEEDINGS OF THE 2024 ACM CONFERENCE ON FAIRNESS, ACCOUNTABILITY, AND TRANSPARENCY, ACM FACCT 2024, 2024, : 1043 - 1054
  • [3] Dynamic heterogeneous federated learning with multi-level prototypes
    Guo, Shunxin
    Wang, Hongsong
    Geng, Xin
    [J]. PATTERN RECOGNITION, 2024, 153
  • [4] FedFixer: Mitigating Heterogeneous Label Noise in Federated Learning
    Ji, Xinyuan
    Zhu, Zhaowei
    Xi, Wei
    Gadyatskaya, Olga
    Song, Zilong
    Cai, Yong
    Liu, Yang
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 11, 2024, : 12830 - 12838
  • [5] Heterogeneous Federated Learning Based on Graph Hypernetwork
    Xu, Zhengyi
    Yang, Liu
    Gu, Shiqiao
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT III, 2023, 14256 : 464 - 476
  • [6] Tackling Data Heterogeneity in Federated Learning with Class Prototypes
    Dai, Yutong
    Chen, Zeyuan
    Li, Junnan
    Heinecke, Shelby
    Sun, Lichao
    Xu, Ran
    [J]. THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 6, 2023, : 7314 - 7322
  • [7] Learning by imitating the classics: Mitigating class imbalance in federated learning via simulated centralized learning
    Zhu, Guogang
    Liu, Xuefeng
    Niu, Jianwei
    Wei, Yucheng
    Tang, Shaojie
    Zhang, Jiayuan
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 255
  • [8] Fair Federated Learning for Heterogeneous Data
    Kanaparthy, Samhita
    Padala, Manisha
    Damle, Sankarshan
    Gujar, Sujit
    [J]. PROCEEDINGS OF THE 5TH JOINT INTERNATIONAL CONFERENCE ON DATA SCIENCE & MANAGEMENT OF DATA, CODS COMAD 2022, 2022, : 298 - 299
  • [9] Federated learning with incremental clustering for heterogeneous data
    Espinoza Castellon, Fabiola
    Mayoue, Aurelien
    Sublemontier, Jacques-Henri
    Gouy-Pailler, Cedric
    [J]. 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [10] FedWS: Dealing with Heterogeneous Data on Federated Learning
    Vieira, Flavio
    Campos, Carlos Alberto V.
    [J]. 2023 IEEE 26TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, ITSC, 2023, : 2010 - 2015