Unsupervised Domain Adaptation Method Based on Domain-Invariant Features Evaluation and Knowledge Distillation for Bearing Fault Diagnosis

被引:0
|
作者
Sun, Kong [1 ]
Bo, Lin [1 ]
Ran, Haoting [1 ]
Tang, Zhi [1 ]
Bi, Yuanliang [1 ]
机构
[1] Chongqing Univ, State Key Lab Mech Transmiss, Chongqing 400044, Peoples R China
基金
中国国家自然科学基金;
关键词
Domain-invariant features; fault diagnosis; knowledge distillation (KD); pseudo-labels; soft attention mechanism (SAM);
D O I
10.1109/TIM.2023.3318747
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Numerous unsupervised domain adaptation (UDA) methods for bearing fault diagnosis rely on extracting domain-invariant features to mitigate the impact of domain shift interference. However, the lack of evaluation criteria results in limited interpretability of domain-invariant features. Additionally, current pseudo-label prediction methods heavily rely on label information or computational resources, and the traditional Softmax function fails to capture valuable information. To address these problems, this article proposes a UDA method based on domain-invariant features evaluation and knowledge distillation (KD) for bearing fault diagnosis. First, mutual information and soft attention mechanism are integrated into the extraction of multivariate features to access the quality of domain-invariant features and enhance interpretability. Then, the concept of KD is introduced to predict pseudo-labels in the target domain without relying on label information or computational resources. Furthermore, an asynchronous feature metric adaptive strategy is developed to adjust the feature alignment metric, considering the maturity and precision of pseudo-labels. The effectiveness and superiority of the proposed method are demonstrated through comparative experiments and ablation studies on two bearing datasets.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Learning Domain-Invariant and Discriminative Features for Homogeneous Unsupervised Domain Adaptation
    ZHANG Yun
    WANG Nianbin
    CAI Shaobin
    Chinese Journal of Electronics, 2020, 29 (06) : 1119 - 1125
  • [2] Unsupervised Method Based on Adversarial Domain Adaptation for Bearing Fault Diagnosis
    Li, Yao
    Yang, Rui
    Wang, Hongshu
    APPLIED SCIENCES-BASEL, 2023, 13 (12):
  • [3] Knowledge Distillation-Based Domain-Invariant Representation Learning for Domain Generalization
    Niu, Ziwei
    Yuan, Junkun
    Ma, Xu
    Xu, Yingying
    Liu, Jing
    Chen, Yen-Wei
    Tong, Ruofeng
    Lin, Lanfen
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 245 - 255
  • [4] Unsupervised domain adaptation bearing fault diagnosis method based on joint feature alignment
    Feng, Xiaoliang
    Zhang, Zhiwei
    Zhao, Aiming
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART C-JOURNAL OF MECHANICAL ENGINEERING SCIENCE, 2024,
  • [5] Domain-invariant adversarial learning with conditional distribution alignment for unsupervised domain adaptation
    Wang, Xingmei
    Sun, Boxuan
    Dong, Hongbin
    IET COMPUTER VISION, 2020, 14 (08) : 642 - 649
  • [6] Integrating Expert Knowledge With Domain Adaptation for Unsupervised Fault Diagnosis
    Wang, Qin
    Taal, Cees
    Fink, Olga
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [7] Knowledge distillation for BERT unsupervised domain adaptation
    Ryu, Minho
    Lee, Geonseok
    Lee, Kichun
    KNOWLEDGE AND INFORMATION SYSTEMS, 2022, 64 (11) : 3113 - 3128
  • [8] Integrating Expert Knowledge with Domain Adaptation for Unsupervised Fault Diagnosis
    Wang, Qin
    Taal, Cees
    Fink, Olga
    IEEE Transactions on Instrumentation and Measurement, 2022, 71
  • [9] Knowledge distillation for BERT unsupervised domain adaptation
    Minho Ryu
    Geonseok Lee
    Kichun Lee
    Knowledge and Information Systems, 2022, 64 : 3113 - 3128
  • [10] Domain-Invariant Progressive Knowledge Distillation for UAV-Based Object Detection
    Yao, Liang
    Liu, Fan
    Zhang, Chuanyi
    Ou, Zhiquan
    Wu, Ting
    IEEE Geoscience and Remote Sensing Letters, 2025, 22