Federated semi-supervised learning with tolerant guidance and powerful classifier in edge scenarios

被引:2
|
作者
Wang, Jinbo [1 ]
Pei, Xikai [2 ]
Wang, Ruijin [1 ]
Zhang, Fengli [1 ]
Chen, Ting [1 ]
机构
[1] Univ Elect Sci & Technol China, Chengdu 611731, Peoples R China
[2] Civil Aviat Adm China, Res Inst 2, Chengdu 610041, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Federated learning; Edge computing; Semi-supervised learning; Image classification;
D O I
10.1016/j.ins.2024.120201
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated Learning is a distributed machine learning method that offers inherent advantages in efficient learning and privacy protection within edge computing scenarios. However, terminal nodes often encounter challenges such as insufficient datasets and a significant amount of unlabelled data, leading to reduced accuracy in multi -party collaborative training models. Prior approaches have typically relied on a single pseudo label from unlabelled data to guide model training, limiting the utilization of knowledge within these data. To address this, this paper proposes a federated semi-supervised learning method (FedTG) tailored for image classification. Specifically, we leverage multiple high probability pseudo labels from unlabelled data to participate in semi-supervised learning, rather than relying on a single pseudo label. This approach mitigates the potential harm caused by errors in a single pseudo label and enables the model to fully capture the knowledge within the unlabelled data. Additionally, recognizing the significance of model classifiers (final neural network layer) in image classification tasks, we propose the exclusion of model classifier updates during the training process using unlabelled data to maintain optimal classification performance. Experiments conducted on real datasets have demonstrated that the FedTG method effectively enhances the accuracy of traditional Federated Learning model.
引用
收藏
页数:18
相关论文
共 50 条
  • [41] Combating Data Imbalances in Federated Semi-supervised Learning with Dual Regulators
    Bai, Sikai
    Li, Shuaicheng
    Zhuang, Weiming
    Zhang, Jie
    Yang, Kunlin
    Hou, Jun
    Zhang, Shuai
    Yi, Shuai
    Gao, Junyu
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 10, 2024, : 10989 - 10997
  • [42] Improving Semi-supervised Federated Learning by Reducing the Gradient Diversity of Models
    Zhang, Zhengming
    Yang, Yaoqing
    Yao, Zhewei
    Yan, Yujun
    Gonzalez, Joseph E.
    Ramchandran, Kannan
    Mahoney, Michael W.
    2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2021, : 1214 - 1225
  • [43] Multi-Party Federated Recommendation Based on Semi-Supervised Learning
    Liu, Xin
    Lv, Jiuluan
    Chen, Feng
    Wei, Qingjie
    He, Hangxuan
    Qian, Ying
    IEEE TRANSACTIONS ON BIG DATA, 2024, 10 (04) : 356 - 370
  • [44] FedECG: A federated semi-supervised learning framework for electrocardiogram abnormalities prediction
    Ying, Zuobin
    Zhang, Guoyang
    Pan, Zijie
    Chu, Chiawei
    Liu, Ximeng
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2023, 35 (06)
  • [45] CoSSL: Co-Learning of Representation and Classifier for Imbalanced Semi-Supervised Learning
    Fan, Yue
    Dai, Dengxin
    Kukleva, Anna
    Schiele, Bernt
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 14554 - 14564
  • [46] SemiFL: Semi-Supervised Federated Learning for Unlabeled Clients with Alternate Training
    Diao, Enmao
    Ding, Jie
    Tarokh, Vahid
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [47] Class Balanced Adaptive Pseudo Labeling for Federated Semi-Supervised Learning
    Li, Ming
    Li, Qingli
    Wang, Yan
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 16292 - 16301
  • [48] GraphFL: A Federated Learning Framework for Semi-Supervised Node Classification on Graphs
    Wang, Binghui
    Li, Ang
    Pang, Meng
    Li, Hai
    Chen, Yiran
    2022 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2022, : 498 - 507
  • [49] On semi-supervised learning
    A. Cholaquidis
    R. Fraiman
    M. Sued
    TEST, 2020, 29 : 914 - 937
  • [50] On semi-supervised learning
    Cholaquidis, A.
    Fraiman, R.
    Sued, M.
    TEST, 2020, 29 (04) : 914 - 937