FedGKD: Federated Graph Knowledge Distillation for privacy-preserving rumor detection

被引:0
|
作者
Zheng, Peng [1 ]
Dou, Yong [1 ]
Yan, Yeqing [1 ]
机构
[1] Natl Univ Def Technol, Sch Comp Sci, Changsha, Peoples R China
基金
中国国家自然科学基金;
关键词
Rumor detection; Federated learning; Privacy-preserving; Knowledge distillation;
D O I
10.1016/j.knosys.2024.112476
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The massive spread of rumors on social networks has caused serious adverse effects on individuals and society, increasing the urgency of rumor detection. Existing detection methods based on deep learning have achieved fruitful results by virtue of their powerful semantic representation capabilities. However, the centralized training mode and the reliance on extensive training data containing user privacy pose significant risks of privacy abuse or leakage. Although federated learning with client-level differential privacy provides a potential solution, it results in a dramatic decline in model performance. To address these issues, we propose a Federated Graph Knowledge Distillation framework (FedGKD), which aims to effectively identify rumors while preserving user privacy. In this framework, we implement anonymization from both the feature and structure dimensions of graphs, and apply differential privacy only to sensitive features to prevent significant deviation in data statistics. Additionally, to improve model generalization performance in federated settings, we learn a lightweight generator at the server to extract global knowledge through knowledge distillation. This knowledge is then broadcast to clients as inductive experience to regulate their local training. Extensive experiments on four publicly available datasets demonstrate that FedGKD outperforms strong baselines and displays outstanding privacy-preserving capabilities.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Adaptive privacy-preserving federated learning
    Xiaoyuan Liu
    Hongwei Li
    Guowen Xu
    Rongxing Lu
    Miao He
    Peer-to-Peer Networking and Applications, 2020, 13 : 2356 - 2366
  • [32] Privacy-preserving Techniques in Federated Learning
    Liu Y.-X.
    Chen H.
    Liu Y.-H.
    Li C.-P.
    Ruan Jian Xue Bao/Journal of Software, 2022, 33 (03): : 1057 - 1092
  • [33] Federated learning for privacy-preserving AI
    Cheng, Yong
    Liu, Yang
    Chen, Tianjian
    Yang, Qiang
    COMMUNICATIONS OF THE ACM, 2020, 63 (12) : 33 - 36
  • [34] Privacy-Preserving and Reliable Federated Learning
    Lu, Yi
    Zhang, Lei
    Wang, Lulu
    Gao, Yuanyuan
    ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2021, PT III, 2022, 13157 : 346 - 361
  • [35] A privacy-preserving federated graph learning framework for threat detection in IoT trigger-action programming
    Xing, Yongheng
    Hu, Liang
    Du, Xinqi
    Shen, Zhiqi
    Hu, Juncheng
    Wang, Feng
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 255
  • [36] Communication-Efficient and Privacy-Preserving Federated Learning via Joint Knowledge Distillation and Differential Privacy in Bandwidth-Constrained Networks
    Gad, Gad
    Gad, Eyad
    Fadlullah, Zubair Md
    Fouda, Mostafa M.
    Kato, Nei
    IEEE Transactions on Vehicular Technology, 2024, 73 (11) : 17586 - 17601
  • [37] PrivFusion: Privacy-Preserving Model Fusion via Decentralized Federated Graph Matching
    Chen, Qian
    Chen, Yiqiang
    Jiang, Xinlong
    Zhang, Teng
    Dai, Weiwei
    Huang, Wuliang
    Yan, Bingjie
    Yan, Zhen
    Lu, Wang
    Ye, Bo
    IEEE Transactions on Knowledge and Data Engineering, 2024, 36 (12) : 9051 - 9064
  • [38] A Privacy-Preserving Subgraph-Level Federated Graph Neural Network via Differential Privacy
    Qiu, Yeqing
    Huang, Chenyu
    Wang, Jianzong
    Huang, Zhangcheng
    Xiao, Jing
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, KSEM 2022, PT III, 2022, 13370 : 165 - 177
  • [39] FedEgo: Privacy-preserving Personalized Federated Graph Learning with Ego-graphs
    Zhang, Taolin
    Mai, Chengyuan
    Chang, Yaomin
    Chen, Chuan
    Shu, Lin
    Zheng, Zibin
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2024, 18 (02)
  • [40] Federated Approach for Privacy-Preserving Traffic Prediction Using Graph Convolutional Network
    Lonare S.
    Bhramaramba R.
    Journal of Shanghai Jiaotong University (Science), 2024, 29 (03) : 509 - 517