FedGKD: Federated Graph Knowledge Distillation for privacy-preserving rumor detection

被引:0
|
作者
Zheng, Peng [1 ]
Dou, Yong [1 ]
Yan, Yeqing [1 ]
机构
[1] Natl Univ Def Technol, Sch Comp Sci, Changsha, Peoples R China
基金
中国国家自然科学基金;
关键词
Rumor detection; Federated learning; Privacy-preserving; Knowledge distillation;
D O I
10.1016/j.knosys.2024.112476
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The massive spread of rumors on social networks has caused serious adverse effects on individuals and society, increasing the urgency of rumor detection. Existing detection methods based on deep learning have achieved fruitful results by virtue of their powerful semantic representation capabilities. However, the centralized training mode and the reliance on extensive training data containing user privacy pose significant risks of privacy abuse or leakage. Although federated learning with client-level differential privacy provides a potential solution, it results in a dramatic decline in model performance. To address these issues, we propose a Federated Graph Knowledge Distillation framework (FedGKD), which aims to effectively identify rumors while preserving user privacy. In this framework, we implement anonymization from both the feature and structure dimensions of graphs, and apply differential privacy only to sensitive features to prevent significant deviation in data statistics. Additionally, to improve model generalization performance in federated settings, we learn a lightweight generator at the server to extract global knowledge through knowledge distillation. This knowledge is then broadcast to clients as inductive experience to regulate their local training. Extensive experiments on four publicly available datasets demonstrate that FedGKD outperforms strong baselines and displays outstanding privacy-preserving capabilities.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] FedKGRec: privacy-preserving federated knowledge graph aware recommender system
    Ma, Xiao
    Zhang, Hongyu
    Zeng, Jiangfeng
    Duan, Yiqi
    Wen, Xuan
    APPLIED INTELLIGENCE, 2024, 54 (19) : 9028 - 9044
  • [2] Selective knowledge sharing for privacy-preserving federated distillation without a good teacher
    Shao, Jiawei
    Wu, Fangzhao
    Zhang, Jun
    NATURE COMMUNICATIONS, 2024, 15 (01)
  • [3] Selective knowledge sharing for privacy-preserving federated distillation without a good teacher
    Jiawei Shao
    Fangzhao Wu
    Jun Zhang
    Nature Communications, 15
  • [4] Ensemble Attention Distillation for Privacy-Preserving Federated Learning
    Gong, Xuan
    Sharma, Abhishek
    Karanam, Srikrishna
    Wu, Ziyan
    Chen, Terrence
    Doermann, David
    Innanje, Arun
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 15056 - 15066
  • [5] Federated Learning With Privacy-Preserving Ensemble Attention Distillation
    Gong, Xuan
    Song, Liangchen
    Vedula, Rishi
    Sharma, Abhishek
    Zheng, Meng
    Planche, Benjamin
    Innanje, Arun
    Chen, Terrence
    Yuan, Junsong
    Doermann, David
    Wu, Ziyan
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (07) : 2057 - 2067
  • [6] Complementary Knowledge Distillation for Robust and Privacy-Preserving Model Serving in Vertical Federated Learning
    Gao, Dashan
    Wan, Sheng
    Fan, Lixin
    Yao, Xin
    Yang, Qiang
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 18, 2024, : 19832 - 19839
  • [7] Personalized and privacy-preserving federated graph neural network
    Liu, Yanjun
    Li, Hongwei
    Hao, Meng
    FRONTIERS IN PHYSICS, 2024, 12
  • [8] Privacy-Preserving Federated Distillation GAN for CIDSs in Industrial CPSs
    Liang, Junwei
    Sadiq, Muhammad
    Cai, Tie
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 5512 - 5517
  • [9] Privacy-Preserving Heterogeneous Personalized Federated Learning with Knowledge
    Pan Y.
    Su Z.
    Ni J.
    Wang Y.
    Zhou J.
    IEEE Transactions on Network Science and Engineering, 2024, 11 (06): : 1 - 14
  • [10] A federated graph neural network framework for privacy-preserving personalization
    Chuhan Wu
    Fangzhao Wu
    Lingjuan Lyu
    Tao Qi
    Yongfeng Huang
    Xing Xie
    Nature Communications, 13