Mitigating data imbalance and generating better prototypes in heterogeneous Federated Graph Learning

被引:2
|
作者
Kong, Xiangjie [1 ]
Yuan, Haopeng [1 ]
Shen, Guojiang [1 ]
Zhou, Hanlin [1 ]
Liu, Weiyao [1 ]
Yang, Yao [2 ]
机构
[1] Zhejiang Univ Technol, Hangzhou 310023, Peoples R China
[2] Zhejiang Lab, Hangzhou 311100, Peoples R China
基金
中国国家自然科学基金;
关键词
Federated graph learning; Heterogeneity; Data enhancement; Prototype;
D O I
10.1016/j.knosys.2024.111876
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Federated Graph Learning (FGL) opens up new possibilities for machine learning in complex networks and distributed training, enabling multiple clients to collaborate on training Graph Neural Networks (GNNs) while preserving privacy. However, there may be differences between participating clients in terms of data distribution, computational power, and model architecture, which requires us to be able to mitigate the problem of heterogeneity across participating clients. Most of the existing model -heterogeneous Federated Learning frameworks are based on non -graph data, which is not sufficiently effective in FGL scenarios. Moreover we find that the model -heterogeneous Federated Learning approach based on prototype learning generates a single global prototype that does not provide good guidelines for each client in the case of multiple heterogeneous clients. Also, the problem of class imbalance of local data in FGL scenarios affects the overall utility. To this end, we propose FGPL, a model heterogeneous FGL framework based on prototype learning and local data augmentation. Specifically, on the one hand, locally, we mitigate the problem of local data imbalance by generating better local prototypes through a node generation method based on global prototypes and local structures. On the other hand, we cope with the domain bias problem by generating targeted global prototypes, and use a comparative learning approach to provide more personalized and correct guidelines for each client's training. We demonstrate with extensive experiments that our approach can greatly improve the prediction of FGL.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Over-the-Air Federated Learning from Heterogeneous Data
    Sery, Tomer
    Shlezinger, Nir
    Cohen, Kobi
    Eldar, Yonina
    IEEE Transactions on Signal Processing, 2021, 69 : 3796 - 3811
  • [42] Data-Free Knowledge Distillation for Heterogeneous Federated Learning
    Zhu, Zhuangdi
    Hong, Junyuan
    Zhou, Jiayu
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [43] Data heterogeneous federated learning algorithm for industrial entity extraction
    Fu, Shengze
    Zhao, Xiaoli
    Yang, Chi
    Fang, Zhijun
    DISPLAYS, 2023, 80
  • [44] On the effectiveness of partial variance reduction in federated learning with heterogeneous data
    Li, Bo
    Schmidt, Mikkel N.
    Alstrom, Tommy S.
    Stich, Sebastian U.
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 3964 - 3973
  • [45] Federated Learning Algorithms with Heterogeneous Data Distributions: An Empirical Evaluation
    Mora, Alessio
    Fantini, Davide
    Bellavista, Paolo
    2022 IEEE/ACM 7TH SYMPOSIUM ON EDGE COMPUTING (SEC 2022), 2022, : 336 - 341
  • [46] Over-the-Air Federated Learning From Heterogeneous Data
    Sery, Tomer
    Shlezinger, Nir
    Cohen, Kobi
    Eldar, Yonina C.
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2021, 69 : 3796 - 3811
  • [47] Using big data and federated learning for generating energy efficiency recommendations
    Varlamis, Iraklis
    Sardianos, Christos
    Chronis, Christos
    Dimitrakopoulos, George
    Himeur, Yassine
    Alsalemi, Abdullah
    Bensaali, Faycal
    Amira, Abbes
    INTERNATIONAL JOURNAL OF DATA SCIENCE AND ANALYTICS, 2023, 16 (03) : 353 - 369
  • [48] Adaptive Clustered Federated Learning for Heterogeneous Data in Edge Computing
    Gong, Biyao
    Xing, Tianzhang
    Liu, Zhidan
    Wang, Junfeng
    Liu, Xiuya
    MOBILE NETWORKS & APPLICATIONS, 2022, 27 (04): : 1520 - 1530
  • [49] Using big data and federated learning for generating energy efficiency recommendations
    Iraklis Varlamis
    Christos Sardianos
    Christos Chronis
    George Dimitrakopoulos
    Yassine Himeur
    Abdullah Alsalemi
    Faycal Bensaali
    Abbes Amira
    International Journal of Data Science and Analytics, 2023, 16 : 353 - 369
  • [50] Mitigating Model Poisoning Attacks on Distributed Learning with Heterogeneous Data
    Xu, Jialt
    Yang, Guangfeng
    Zheng, Ziyan
    Huang, Shao-Lun
    22ND IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, ICMLA 2023, 2023, : 738 - 743