Federated Transfer Learning for Bearing Fault Diagnosis With Discrepancy-Based Weighted Federated Averaging

被引:76
|
作者
Chen, Junbin [1 ]
Li, Jipu [1 ]
Huang, Ruyi [2 ]
Yue, Ke [1 ]
Chen, Zhuyun [1 ]
Li, Weihua [2 ]
机构
[1] South China Univ Technol, Sch Mech & Automot Engn, Guangzhou 510640, Peoples R China
[2] South China Univ Technol, Shien Ming Wu Sch Intelligent Engn, Guangzhou 510640, Peoples R China
基金
中国国家自然科学基金;
关键词
Data models; Training; Fault diagnosis; Transfer learning; Collaborative work; Machinery; Data privacy; Ball bearings; fault diagnosis; federated transfer learning (FTL); maximum mean discrepancy (MMD); weighted federated averaging (WFA); MACHINERY; NETWORK;
D O I
10.1109/TIM.2022.3180417
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Generally, high performance of deep learning (DL)-based machinery fault diagnosis methods relies on abundant labeled fault samples under various working conditions, while they are usually stored by different users and not communicated with each other due to data privacy protection. Federated learning (FL) is a possible solution, but the traditional federated averaging (FedAvg) algorithm in FL ignores the potential domain shift of different FL participants, which limits its further application. Therefore, a federated transfer learning (FTL) framework with discrepancy-based weighted federated averaging (D-WFA) is proposed to train the good global diagnosis model collaboratively as well as protect data privacy. First, local labeled source domain data and unlabeled target domain data are utilized to update multiple local models with generalization ability. Then, a maximum mean discrepancy (MMD)-based dynamic weighted averaging algorithm is designed to aggregate the updated local models with automatically learned weight. The proposed D-WFA overcomes the disadvantage of the traditional FedAvg algorithm, which assumes that all clients have the same contribution in constructing the global model during FL training. Experiment results on a bearing dataset show that the proposed D-WFA outperforms the traditional FedAvg and relative FTL method, which offers a promising solution in privacy-preserving machine learning for fault diagnosis.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Privacy-preserving gradient boosting tree: Vertical federated learning for collaborative bearing fault diagnosis
    Xia, Liqiao
    Zheng, Pai
    Li, Jinjie
    Tang, Wangchujun
    Zhang, Xiangying
    IET COLLABORATIVE INTELLIGENT MANUFACTURING, 2022, 4 (03) : 208 - 219
  • [42] FedCostWAvg: A New Averaging for Better Federated Learning
    Machler, Leon
    Ezhov, Ivan
    Kofler, Florian
    Shit, Suprosanna
    Paetzold, Johannes C.
    Loehr, Timo
    Zimmer, Claus
    Wiestler, Benedikt
    Menze, Bjoern H.
    BRAINLESION: GLIOMA, MULTIPLE SCLEROSIS, STROKE AND TRAUMATIC BRAIN INJURIES, BRAINLES 2021, PT II, 2022, 12963 : 383 - 391
  • [43] SCAFFOLD Stochastic Controlled Averaging for Federated Learning
    Karimireddy, Sai Praneeth
    Kale, Satyen
    Mohri, Mehryar
    Reddi, Sashank J.
    Stich, Sebastian U.
    Suresh, Ananda Theertha
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [44] Adapted Weighted Aggregation in Federated Learning
    Tang, Yitong
    THIRTY-EIGTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 21, 2024, : 23763 - 23765
  • [45] Federated Learning Based Fault Diagnosis Driven by Intra-Client Imbalance Degree
    Zhou, Funa
    Yang, Yi
    Wang, Chaoge
    Hu, Xiong
    ENTROPY, 2023, 25 (04)
  • [46] Fault diagnosis of intelligent distribution system based on privacy-enhanced federated learning
    Chen, Yifang
    Sun, Zhiqing
    Xuan, Yi
    Lou, Yinan
    Wang, Qifeng
    Guo, Fanghong
    High Technology Letters, 2024, 30 (04) : 424 - 432
  • [47] Fault Diagnosis of Multiple Railway High Speed Train Bogies Based on Federated Learning
    Du J.
    Qin N.
    Jia X.
    Zhang Y.
    Huang D.
    Xinan Jiaotong Daxue Xuebao/Journal of Southwest Jiaotong University, 2024, 59 (01): : 185 - 192
  • [48] Fault diagnosis of intelligent distribution system based on privacy-enhanced federated learning
    陈益芳
    SUN Zhiqing
    XUAN Yi
    LOU Yinan
    WANG Qifeng
    GUO Fanghong
    High Technology Letters, 2024, 30 (04) : 424 - 432
  • [49] Federated Machine Learning for Skin Lesion Diagnosis: An Asynchronous and Weighted Approach
    Yaqoob, Muhammad Mateen
    Alsulami, Musleh
    Khan, Muhammad Amir
    Alsadie, Deafallah
    Saudagar, Abdul Khader Jilani
    AlKhathami, Mohammed
    DIAGNOSTICS, 2023, 13 (11)
  • [50] FUNAvg: Federated Uncertainty Weighted Averaging for Datasets with Diverse Labels
    Toelle, Malte
    Navarro, Fernando
    Eble, Sebastian
    Wolf, Ivo
    Menze, Bjoern
    Engelhardt, Sandy
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT X, 2024, 15010 : 405 - 415