Self-Attention Metric Learning Based on Multiscale Feature Fusion for Few-Shot Fault Diagnosis

被引:6
|
作者
Xie, Jingsong [1 ]
Liu, Jie [2 ]
Ding, Tianqi [2 ]
Wang, Tiantian [1 ]
Yu, Tianjian [1 ]
机构
[1] Cent South Univ, Sch Traff & Transportat Engn, Changsha 410075, Peoples R China
[2] Xian Univ Technol, Sch Printing Packaging & Digital Media, Xian 710048, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Measurement; Fault diagnosis; Training; Data models; Task analysis; Deep learning; few-shot fault diagnosis; metric learning; multiscale feature fusion (MSFF); self-attention (SA) mechanism;
D O I
10.1109/JSEN.2023.3296750
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The intelligent diagnosis model based on deep learning method can effectively and accurately diagnose the health state of bearings widely used in various mechanical equipment. However, in engineering practice, it is difficult to obtain sufficient labeled fault data, which would reduce the diagnosis performance. In order to solve the above problem, this article proposes a self-attention metric learning based on multiscale feature fusion to classify the bearing fault with few shots. The proposed few-shot intelligent diagnosis model mainly contains the feature extraction module and metric learning module. First, the vibration data need to be combined in pairs to form sample pairs, which are input into the feature extraction module based on multiscale feature fusion (MSFF). This input approach can increase the learning tasks so as to alleviate the problem of insufficient training samples. Then, the extracted features are concatenated and input into the metric learning module whose learning ability is improved by adding the self-attention (SA) network, and the input features are eventually converted into the similarity. Finally, the fault type can be identified according to the maximum similarity value between the test sample and samples with different labels. Three experiment cases are conducted to validate the performance of proposed intelligent diagnosis model. The experimental results show that the proposed model can accurately classify the bearing fault with few-shot case. Additionally, the comparison experiments with the traditional models have also validated the advantage of the proposed intelligent diagnosis model for few-shot case.
引用
收藏
页码:19771 / 19782
页数:12
相关论文
共 50 条
  • [1] Adaptive Meta Transfer Learning with Efficient Self-Attention for Few-Shot Bearing Fault Diagnosis
    Jun Zhao
    Tang Tang
    Ying Yu
    Jingwei Wang
    Tianyuan Yang
    Ming Chen
    Jie Wu
    [J]. Neural Processing Letters, 2023, 55 : 949 - 968
  • [2] Adaptive Meta Transfer Learning with Efficient Self-Attention for Few-Shot Bearing Fault Diagnosis
    Zhao, Jun
    Tang, Tang
    Yu, Ying
    Wang, Jingwei
    Yang, Tianyuan
    Chen, Ming
    Wu, Jie
    [J]. NEURAL PROCESSING LETTERS, 2023, 55 (02) : 949 - 968
  • [3] SELF-ATTENTION RELATION NETWORK FOR FEW-SHOT LEARNING
    Hui, Binyuan
    Zhu, Pengfei
    Hu, Qinghua
    Wang, Qilong
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2019, : 198 - 203
  • [4] Few-shot learning based on prototype rectification with a self-attention mechanism
    Zhao, Peng
    Wang, Liang
    Zhao, Xuyang
    Liu, Huiting
    Ji, Xia
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 249
  • [5] Few-Shot Learning Based on Self-Attention and Auto-Encoder
    Ji, Zhong
    Chai, Xingliang
    [J]. Tianjin Daxue Xuebao (Ziran Kexue yu Gongcheng Jishu Ban)/Journal of Tianjin University Science and Technology, 2021, 54 (04): : 338 - 345
  • [6] Self-Attention Message Passing for Contrastive Few-Shot Learning
    Shirekar, Ojas Kishorkumar
    Singh, Anuj
    Jamali-Rad, Hadi
    [J]. 2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 5415 - 5425
  • [7] SAPENet: Self-Attention based Prototype Enhancement Network for Few-shot Learning
    Huang, Xilang
    Choi, Seon Han
    [J]. PATTERN RECOGNITION, 2023, 135
  • [8] SaberNet: Self-attention based effective relation network for few-shot learning
    Li, Zijun
    Hu, Zhengping
    Luo, Weiwei
    Hu, Xiao
    [J]. PATTERN RECOGNITION, 2023, 133
  • [9] Unified feature learning network for few-shot fault diagnosis
    Xu, Yan
    Ma, Xinyao
    Wang, Xuan
    Wang, Jinjia
    Tang, Gang
    Ji, Zhong
    [J]. Neurocomputing, 2024, 598
  • [10] Few-Shot Fault Diagnosis Based on Heterogeneous Information Fusion and Meta Learning
    Zhang, Xiaofei
    Tang, Jingbo
    Qu, Yinpeng
    Qin, Guojun
    Guo, Lei
    Xie, Jinping
    Long, Zhuo
    [J]. IEEE SENSORS JOURNAL, 2023, 23 (18) : 21433 - 21442