Federated semi-supervised learning with tolerant guidance and powerful classifier in edge scenarios

被引:2
|
作者
Wang, Jinbo [1 ]
Pei, Xikai [2 ]
Wang, Ruijin [1 ]
Zhang, Fengli [1 ]
Chen, Ting [1 ]
机构
[1] Univ Elect Sci & Technol China, Chengdu 611731, Peoples R China
[2] Civil Aviat Adm China, Res Inst 2, Chengdu 610041, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Federated learning; Edge computing; Semi-supervised learning; Image classification;
D O I
10.1016/j.ins.2024.120201
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated Learning is a distributed machine learning method that offers inherent advantages in efficient learning and privacy protection within edge computing scenarios. However, terminal nodes often encounter challenges such as insufficient datasets and a significant amount of unlabelled data, leading to reduced accuracy in multi -party collaborative training models. Prior approaches have typically relied on a single pseudo label from unlabelled data to guide model training, limiting the utilization of knowledge within these data. To address this, this paper proposes a federated semi-supervised learning method (FedTG) tailored for image classification. Specifically, we leverage multiple high probability pseudo labels from unlabelled data to participate in semi-supervised learning, rather than relying on a single pseudo label. This approach mitigates the potential harm caused by errors in a single pseudo label and enables the model to fully capture the knowledge within the unlabelled data. Additionally, recognizing the significance of model classifiers (final neural network layer) in image classification tasks, we propose the exclusion of model classifier updates during the training process using unlabelled data to maintain optimal classification performance. Experiments conducted on real datasets have demonstrated that the FedTG method effectively enhances the accuracy of traditional Federated Learning model.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] Asynchronous Semi-Supervised Federated Learning with Provable Convergence in Edge Computing
    Yang, Nan
    Yuan, Dong
    Zhang, Yuning
    Deng, Yongkun
    Bao, Wei
    IEEE NETWORK, 2022, 36 (05): : 136 - 143
  • [2] SemiPFL: Personalized Semi-Supervised Federated Learning Framework for Edge Intelligence
    Tashakori, Arvin
    Zhang, Wenwen
    Wang, Z. Jane
    Servati, Peyman
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (10) : 9161 - 9176
  • [3] Semi-Supervised Federated Heterogeneous Transfer Learning
    Feng, Siwei
    Li, Boyang
    Yu, Han
    Liu, Yang
    Yang, Qiang
    KNOWLEDGE-BASED SYSTEMS, 2022, 252
  • [4] Evolutionary Classifier Ensembles for Semi-supervised Learning
    Zhang, Qingjiu
    Sun, Shiliang
    2010 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS IJCNN 2010, 2010,
  • [5] Federated Active Semi-Supervised Learning With Communication Efficiency
    Zhang, Chen
    Xie, Yu
    Bai, Hang
    Hu, Xiongwei
    Yu, Bin
    Gao, Yuan
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2023, 53 (11): : 6744 - 6756
  • [6] Federated Cycling (FedCy): Semi-Supervised Federated Learning of Surgical Phases
    Kassem, Hasan
    Alapatt, Deepak
    Mascagni, Pietro
    Karargyris, Alexandros
    Padoy, Nicolas
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (07) : 1920 - 1931
  • [7] Semi-supervised federated learning on evolving data streams
    Mawuli, Cobbinah B.
    Kumar, Jay
    Nanor, Ebenezer
    Fu, Shangxuan
    Pan, Liangxu
    Yang, Qinli
    Zhang, Wei
    Shao, Junming
    INFORMATION SCIENCES, 2023, 643
  • [8] Federated Learning in Healthcare with Unsupervised and Semi-Supervised Methods
    Panos-Basterra, Juan
    Dolores Ruiz, M.
    Martin-Bautista, Maria J.
    FLEXIBLE QUERY ANSWERING SYSTEMS, FQAS 2023, 2023, 14113 : 182 - 193
  • [9] Misbehavior detection system with semi-supervised federated learning
    Kristianto, Edy
    Lin, Po-Ching
    Hwang, Ren-Hung
    VEHICULAR COMMUNICATIONS, 2023, 41
  • [10] Uncertainty Minimization for Personalized Federated Semi-Supervised Learning
    Shi, Yanhang
    Chen, Siguang
    Zhang, Haijun
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2023, 10 (02): : 1060 - 1073