FedGKD: Federated Graph Knowledge Distillation for privacy-preserving rumor detection

被引:0
|
作者
Zheng, Peng [1 ]
Dou, Yong [1 ]
Yan, Yeqing [1 ]
机构
[1] Natl Univ Def Technol, Sch Comp Sci, Changsha, Peoples R China
基金
中国国家自然科学基金;
关键词
Rumor detection; Federated learning; Privacy-preserving; Knowledge distillation;
D O I
10.1016/j.knosys.2024.112476
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The massive spread of rumors on social networks has caused serious adverse effects on individuals and society, increasing the urgency of rumor detection. Existing detection methods based on deep learning have achieved fruitful results by virtue of their powerful semantic representation capabilities. However, the centralized training mode and the reliance on extensive training data containing user privacy pose significant risks of privacy abuse or leakage. Although federated learning with client-level differential privacy provides a potential solution, it results in a dramatic decline in model performance. To address these issues, we propose a Federated Graph Knowledge Distillation framework (FedGKD), which aims to effectively identify rumors while preserving user privacy. In this framework, we implement anonymization from both the feature and structure dimensions of graphs, and apply differential privacy only to sensitive features to prevent significant deviation in data statistics. Additionally, to improve model generalization performance in federated settings, we learn a lightweight generator at the server to extract global knowledge through knowledge distillation. This knowledge is then broadcast to clients as inductive experience to regulate their local training. Extensive experiments on four publicly available datasets demonstrate that FedGKD outperforms strong baselines and displays outstanding privacy-preserving capabilities.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Extracting Privacy-Preserving Subgraphs in Federated Graph Learning using Information Bottleneck
    Zhang, Chenhan
    Wang, Weiqi
    Yu, James J. Q.
    Yu, Shui
    PROCEEDINGS OF THE 2023 ACM ASIA CONFERENCE ON COMPUTER AND COMMUNICATIONS SECURITY, ASIA CCS 2023, 2023, : 109 - 121
  • [42] Privacy-Preserving Federated Graph Neural Network Learning on Non-IID Graph Data
    Zhang K.
    Cai Z.
    Seo D.
    Wireless Communications and Mobile Computing, 2023, 2023
  • [43] FedPDD: A Privacy-preserving Double Distillation Framework for Cross-silo Federated Recommendation
    Wan, Sheng
    Gao, Dashan
    Gu, Hanlin
    Hu, Daning
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [44] Intrusion Detection Based on Privacy-Preserving Federated Learning for the Industrial IoT
    Ruzafa-Alcazar, Pedro
    Fernandez-Saura, Pablo
    Marmol-Campos, Enrique
    Gonzalez-Vidal, Aurora
    Hernandez-Ramos, Jose L.
    Bernal-Bernabe, Jorge
    Skarmeta, Antonio F.
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (02) : 1145 - 1154
  • [45] Privacy-Preserving Anomaly Detection in Cloud Manufacturing Via Federated Transformer
    Ma, Shiyao
    Nie, Jiangtian
    Kang, Jiawen
    Lyu, Lingjuan
    Liu, Ryan Wen
    Zhao, Ruihui
    Liu, Ziyao
    Niyato, Dusit
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (12) : 8977 - 8987
  • [46] Fuzzy Federated Learning for Privacy-Preserving Detection of Adolescent Idiopathic Scoliosis
    Wu, Xiaotong
    Ding, Yan
    Zhou, Xiaokang
    Xu, Yanwei
    Wang, Shoujin
    Xu, Xiaolong
    Qi, Lianyong
    IEEE Transactions on Fuzzy Systems, 2024, 32 (10) : 5493 - 5507
  • [47] Medical Image Object Detection Algorithm for Privacy-Preserving Federated Learning
    Wang S.
    Lu S.
    Cao B.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2021, 33 (10): : 1553 - 1562
  • [48] Explainable federated learning for privacy-preserving bangla sign language detection
    Diba, Bidita Sarkar
    Plabon, Jayonto Dutta
    Rahman, M. D. Mahmudur
    Mistry, Durjoy
    Saha, Aloke Kumar
    Mridha, M. F.
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 134
  • [49] Preserving Privacy in Federated Learning with Ensemble Cross-Domain Knowledge Distillation
    Gong, Xuan
    Sharma, Abhishek
    Karanam, Srikrishna
    Wu, Ziyan
    Chen, Terrence
    Doermann, David
    Innanje, Arun
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 11891 - 11899
  • [50] Towards driver distraction detection: a privacy-preserving federated learning approach
    Zhou, Wenguang
    Jia, Zhiwei
    Feng, Chao
    Lu, Huali
    Lyu, Feng
    Li, Ling
    PEER-TO-PEER NETWORKING AND APPLICATIONS, 2024, 17 (02) : 896 - 910