Mitigating data imbalance and generating better prototypes in heterogeneous Federated Graph Learning

被引:2
|
作者
Kong, Xiangjie [1 ]
Yuan, Haopeng [1 ]
Shen, Guojiang [1 ]
Zhou, Hanlin [1 ]
Liu, Weiyao [1 ]
Yang, Yao [2 ]
机构
[1] Zhejiang Univ Technol, Hangzhou 310023, Peoples R China
[2] Zhejiang Lab, Hangzhou 311100, Peoples R China
基金
中国国家自然科学基金;
关键词
Federated graph learning; Heterogeneity; Data enhancement; Prototype;
D O I
10.1016/j.knosys.2024.111876
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Federated Graph Learning (FGL) opens up new possibilities for machine learning in complex networks and distributed training, enabling multiple clients to collaborate on training Graph Neural Networks (GNNs) while preserving privacy. However, there may be differences between participating clients in terms of data distribution, computational power, and model architecture, which requires us to be able to mitigate the problem of heterogeneity across participating clients. Most of the existing model -heterogeneous Federated Learning frameworks are based on non -graph data, which is not sufficiently effective in FGL scenarios. Moreover we find that the model -heterogeneous Federated Learning approach based on prototype learning generates a single global prototype that does not provide good guidelines for each client in the case of multiple heterogeneous clients. Also, the problem of class imbalance of local data in FGL scenarios affects the overall utility. To this end, we propose FGPL, a model heterogeneous FGL framework based on prototype learning and local data augmentation. Specifically, on the one hand, locally, we mitigate the problem of local data imbalance by generating better local prototypes through a node generation method based on global prototypes and local structures. On the other hand, we cope with the domain bias problem by generating targeted global prototypes, and use a comparative learning approach to provide more personalized and correct guidelines for each client's training. We demonstrate with extensive experiments that our approach can greatly improve the prediction of FGL.
引用
下载
收藏
页数:11
相关论文
共 50 条
  • [21] Federated learning of molecular properties with graph neural networks in a heterogeneous setting
    Zhu, Wei
    Luo, Jiebo
    White, Andrew D.
    PATTERNS, 2022, 3 (06):
  • [22] FedHGL: Cross-Institutional Federated Heterogeneous Graph Learning for IoT
    Wei, Xiangyu
    Chen, Guorong
    Zhu, Yongsheng
    Hu, Fuqiang
    Zhang, Chongzhen
    Han, Zhen
    Wang, Wei
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (15): : 25590 - 25599
  • [23] Towards Accelerating the Adoption of Federated Learning for Heterogeneous Data
    Ntokos, Christos
    Bakalos, Nikolaos
    Kalogeras, Dimitrios
    PROCEEDINGS OF THE 16TH ACM INTERNATIONAL CONFERENCE ON PERVASIVE TECHNOLOGIES RELATED TO ASSISTIVE ENVIRONMENTS, PETRA 2023, 2023, : 617 - 624
  • [24] Data-Heterogeneous Hierarchical Federated Learning with Mobility
    Chen, Tan
    Yan, Jintao
    Sun, Yuxuan
    Zhou, Sheng
    Gunduz, Deniz
    Niu, Zhisheng
    2023 35TH INTERNATIONAL TELETRAFFIC CONGRESS, ITC-35, 2023,
  • [25] Robust Heterogeneous Federated Learning under Data Corruption
    Fang, Xiuwen
    Ye, Mang
    Yang, Xiyuan
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 4997 - 5007
  • [26] Convergence Analysis of Sequential Federated Learning on Heterogeneous Data
    Li, Yipeng
    Lyu, Xinchen
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [27] Study of Data Imbalance and Asynchronous Aggregation Algorithm on Federated Learning System
    Diwangkara, Senapati Sang
    Kistijantoro, Achmad Imam
    2020 INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY SYSTEMS AND INNOVATION (ICITSI), 2020, : 276 - 281
  • [28] FedISM: Enhancing Data Imbalance via Shared Model in Federated Learning
    Chung, Wu-Chun
    Lin, Yan-Hui
    Fang, Sih-Han
    MATHEMATICS, 2023, 11 (10)
  • [29] FedIR: Learning Invariant Representations from Heterogeneous Data in Federated Learning
    Zheng, Xi
    Xie, Hongcheng
    Guo, Yu
    Bie, Rongfang
    2023 19TH INTERNATIONAL CONFERENCE ON MOBILITY, SENSING AND NETWORKING, MSN 2023, 2023, : 644 - 651
  • [30] Learning Efficiency Maximization for Wireless Federated Learning With Heterogeneous Data and Clients
    Ouyang J.
    Liu Y.
    IEEE Transactions on Cognitive Communications and Networking, 2024, 10 (06): : 1 - 1