Mining knowledge from unlabeled data for fault diagnosis: A multi-task self-supervised approach

被引:5
|
作者
Kong, Depeng [1 ]
Huang, Weidi [1 ]
Zhao, Libo [2 ]
Ding, Jianjun [2 ]
Wu, Haiteng [3 ,4 ]
Yang, Geng [1 ,4 ]
机构
[1] Zhejiang Univ, Sch Mech Engn, State Key Lab Fluid Power & Mechatron Syst, Hangzhou 310027, Zhejiang, Peoples R China
[2] Xi An Jiao Tong Univ, Sch Mech Engn, State Key Lab Mfg Syst Engn, Xian 710049, Shaanxi, Peoples R China
[3] Hangzhou Shenhao Technol Co Ltd, Hangzhou 311100, Zhejiang, Peoples R China
[4] Zhejiang Key Lab Intelligent Operat & Maintenance, Hangzhou 311100, Zhejiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Fault diagnosis; Knowledge mining; Knowledge transfer; Self-supervised learning; NEURAL-NETWORK; AUTOENCODER; BEARINGS; MACHINE; CNN;
D O I
10.1016/j.ymssp.2024.111189
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
Deep learning -assisted fault diagnosis has achieved significant success in recent years due to its capability of automatic feature learning and intelligent decision -making. Nonetheless, supervised methods are limited by their demands for annotations and fail to explore the growing unlabeled data generated by monitoring devices. An urgent need arises for an efficient approach to utilizing massive unlabeled data to facilitate fault diagnosis. However, existing unsupervised approaches usually rely on a single task for representation learning and lack the synergistic consideration of the cooperation of multiple tasks. To this end, a multi -task self -supervised approach is proposed to comprehensively mine diagnostic knowledge from unlabeled data. Three self -supervised tasks, namely Contrastive similarity matching, Pseudo Label predicting, and Intra-sample temporal relation reasoning (CPLI), are designed to learn representations of vibration signals at inter -instance, instance, and inner -instance levels, respectively. They are meticulously designed and combined to work corporately. The first task focuses on estimating similarities among pairs of augmented samples, while the second task helps this process by guiding the model to identify augmentation methods. As an important complement, the third task delves into the temporal relations among pieces of a time series. Three case studies demonstrate the superiority of the CPLI over state-of-the-art methods in terms of domain adaptability and diagnostic accuracy. These findings highlight its potential for leveraging unlabeled monitoring data to benefit fault diagnosis.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] Self-supervised knowledge mining from unlabeled data for bearing fault diagnosis under limited annotations
    Kong, Depeng
    Zhao, Libo
    Huang, Xiaoyan
    Huang, Weidi
    Ding, Jianjun
    Yao, Yeming
    Xu, Lilin
    Yang, Po
    Yang, Geng
    MEASUREMENT, 2023, 220
  • [2] Multi-task Self-Supervised Visual Learning
    Doersch, Carl
    Zisserman, Andrew
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 2070 - 2079
  • [3] Multi-task Semantic Matching with Self-supervised Learning
    Chen Y.
    Qiu X.
    Beijing Daxue Xuebao (Ziran Kexue Ban)/Acta Scientiarum Naturalium Universitatis Pekinensis, 2022, 58 (01): : 83 - 90
  • [4] Multi-task Self-Supervised Adaptation for Reinforcement Learning
    Wu, Keyu
    Chen, Zhenghua
    Wu, Min
    Xiang, Shili
    Jin, Ruibing
    Zhang, Le
    Li, Xiaoli
    2022 IEEE 17TH CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA), 2022, : 15 - 20
  • [5] Multi-Task Self-Supervised Learning for Disfluency Detection
    Wang, Shaolei
    Che, Wanxiang
    Liu, Qi
    Qin, Pengda
    Liu, Ting
    Wang, William Yang
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 9193 - 9200
  • [6] Deep Self-Supervised Domain Adaptation Network for Fault Diagnosis of Rotating Machine With Unlabeled Data
    Li, Jipu
    Huang, Ruyi
    Chen, Junbin
    Xia, Jingyan
    Chen, Zhuyun
    Li, Weihua
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [7] A Novel Multi-Task Self-Supervised Transfer Learning Framework for Cross-Machine Rolling Bearing Fault Diagnosis
    Zhao, Lujia
    He, Yuling
    Dai, Derui
    Wang, Xiaolong
    Bai, Honghua
    Huang, Weiling
    ELECTRONICS, 2024, 13 (23):
  • [8] Self-supervised multi-task learning for medical image analysis
    Yu, Huihui
    Dai, Qun
    PATTERN RECOGNITION, 2024, 150
  • [9] MULTI-TASK SELF-SUPERVISED LEARNING FOR ROBUST SPEECH RECOGNITION
    Ravanelli, Mirco
    Zhong, Jianyuan
    Pascual, Santiago
    Swietojanski, Pawel
    Monteiro, Joao
    Trmal, Jan
    Bengio, Yoshua
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 6989 - 6993
  • [10] Multi-task Self-supervised Few-Shot Detection
    Zhang, Guangyong
    Duan, Lijuan
    Wang, Wenjian
    Gong, Zhi
    Ma, Bian
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT XII, 2024, 14436 : 107 - 119