Mitigating data imbalance and generating better prototypes in heterogeneous Federated Graph Learning

被引:2
|
作者
Kong, Xiangjie [1 ]
Yuan, Haopeng [1 ]
Shen, Guojiang [1 ]
Zhou, Hanlin [1 ]
Liu, Weiyao [1 ]
Yang, Yao [2 ]
机构
[1] Zhejiang Univ Technol, Hangzhou 310023, Peoples R China
[2] Zhejiang Lab, Hangzhou 311100, Peoples R China
基金
中国国家自然科学基金;
关键词
Federated graph learning; Heterogeneity; Data enhancement; Prototype;
D O I
10.1016/j.knosys.2024.111876
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Federated Graph Learning (FGL) opens up new possibilities for machine learning in complex networks and distributed training, enabling multiple clients to collaborate on training Graph Neural Networks (GNNs) while preserving privacy. However, there may be differences between participating clients in terms of data distribution, computational power, and model architecture, which requires us to be able to mitigate the problem of heterogeneity across participating clients. Most of the existing model -heterogeneous Federated Learning frameworks are based on non -graph data, which is not sufficiently effective in FGL scenarios. Moreover we find that the model -heterogeneous Federated Learning approach based on prototype learning generates a single global prototype that does not provide good guidelines for each client in the case of multiple heterogeneous clients. Also, the problem of class imbalance of local data in FGL scenarios affects the overall utility. To this end, we propose FGPL, a model heterogeneous FGL framework based on prototype learning and local data augmentation. Specifically, on the one hand, locally, we mitigate the problem of local data imbalance by generating better local prototypes through a node generation method based on global prototypes and local structures. On the other hand, we cope with the domain bias problem by generating targeted global prototypes, and use a comparative learning approach to provide more personalized and correct guidelines for each client's training. We demonstrate with extensive experiments that our approach can greatly improve the prediction of FGL.
引用
收藏
页数:11
相关论文
共 50 条
  • [32] Fine-Tuned Personality Federated Learning for Graph Data
    Xue, Meiting
    Zhou, Zian
    Jiao, Pengfei
    Tang, Huijun
    IEEE TRANSACTIONS ON BIG DATA, 2024, 10 (03) : 313 - 319
  • [33] Mitigating the performance sacrifice in DP-satisfied federated settings through graph contrastive learning
    Yang, Haoran
    Zhao, Xiangyu
    Li, Muyang
    Chen, Hongxu
    Xu, Guandong
    INFORMATION SCIENCES, 2023, 648
  • [34] Federated variational generative learning for heterogeneous data in distributed environments
    Xie W.
    Xiong R.
    Zhang J.
    Jin J.
    Luo J.
    Journal of Parallel and Distributed Computing, 2024, 191
  • [35] Adaptive Clustered Federated Learning for Heterogeneous Data in Edge Computing
    Biyao Gong
    Tianzhang Xing
    Zhidan Liu
    Junfeng Wang
    Xiuya Liu
    Mobile Networks and Applications, 2022, 27 : 1520 - 1530
  • [36] Wireless Federated Distillation for Distributed Edge Learning with Heterogeneous Data
    Ahn, Jin-Hyun
    Simeone, Osvaldo
    Kang, Joonhyuk
    2019 IEEE 30TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (PIMRC), 2019, : 1138 - 1143
  • [37] Adaptive Clustered Federated Learning for Heterogeneous Data in Edge Computing
    Gong, Biyao
    Xing, Tianzhang
    Liu, Zhidan
    Wang, Junfeng
    Liu, Xiuya
    Mobile Networks and Applications, 2022, 27 (04): : 1520 - 1530
  • [38] Clustering-Based Federated Learning for Heterogeneous IoT Data
    Li, Shumin
    Wei, Linna
    Zhang, Weidong
    Wu, Xuangou
    2023 IEEE INTERNATIONAL CONFERENCES ON INTERNET OF THINGS, ITHINGS IEEE GREEN COMPUTING AND COMMUNICATIONS, GREENCOM IEEE CYBER, PHYSICAL AND SOCIAL COMPUTING, CPSCOM IEEE SMART DATA, SMARTDATA AND IEEE CONGRESS ON CYBERMATICS,CYBERMATICS, 2024, : 172 - 179
  • [39] FedMatch: Federated Learning Over Heterogeneous Question Answering Data
    Chen, Jiangui
    Zhang, Ruqing
    Guo, Jiafeng
    Fan, Yixing
    Cheng, Xueqi
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 181 - 190
  • [40] Understanding and Improving Model Averaging in Federated Learning on Heterogeneous Data
    Zhou T.
    Lin Z.
    Zhang J.
    Tsang D.H.
    IEEE Transactions on Mobile Computing, 2024, 23 (12) : 1 - 16