Mining knowledge from unlabeled data for fault diagnosis: A multi-task self-supervised approach

被引:5
|
作者
Kong, Depeng [1 ]
Huang, Weidi [1 ]
Zhao, Libo [2 ]
Ding, Jianjun [2 ]
Wu, Haiteng [3 ,4 ]
Yang, Geng [1 ,4 ]
机构
[1] Zhejiang Univ, Sch Mech Engn, State Key Lab Fluid Power & Mechatron Syst, Hangzhou 310027, Zhejiang, Peoples R China
[2] Xi An Jiao Tong Univ, Sch Mech Engn, State Key Lab Mfg Syst Engn, Xian 710049, Shaanxi, Peoples R China
[3] Hangzhou Shenhao Technol Co Ltd, Hangzhou 311100, Zhejiang, Peoples R China
[4] Zhejiang Key Lab Intelligent Operat & Maintenance, Hangzhou 311100, Zhejiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Fault diagnosis; Knowledge mining; Knowledge transfer; Self-supervised learning; NEURAL-NETWORK; AUTOENCODER; BEARINGS; MACHINE; CNN;
D O I
10.1016/j.ymssp.2024.111189
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
Deep learning -assisted fault diagnosis has achieved significant success in recent years due to its capability of automatic feature learning and intelligent decision -making. Nonetheless, supervised methods are limited by their demands for annotations and fail to explore the growing unlabeled data generated by monitoring devices. An urgent need arises for an efficient approach to utilizing massive unlabeled data to facilitate fault diagnosis. However, existing unsupervised approaches usually rely on a single task for representation learning and lack the synergistic consideration of the cooperation of multiple tasks. To this end, a multi -task self -supervised approach is proposed to comprehensively mine diagnostic knowledge from unlabeled data. Three self -supervised tasks, namely Contrastive similarity matching, Pseudo Label predicting, and Intra-sample temporal relation reasoning (CPLI), are designed to learn representations of vibration signals at inter -instance, instance, and inner -instance levels, respectively. They are meticulously designed and combined to work corporately. The first task focuses on estimating similarities among pairs of augmented samples, while the second task helps this process by guiding the model to identify augmentation methods. As an important complement, the third task delves into the temporal relations among pieces of a time series. Three case studies demonstrate the superiority of the CPLI over state-of-the-art methods in terms of domain adaptability and diagnostic accuracy. These findings highlight its potential for leveraging unlabeled monitoring data to benefit fault diagnosis.
引用
收藏
页数:20
相关论文
共 50 条
  • [41] Mining Product Features from the Web: A Self-supervised Approach
    Ferrez, Remi
    de Groc, Clement
    Couto, Javier
    WEB INFORMATION SYSTEMS AND TECHNOLOGIES, WEBIST 2012, 2013, 140 : 296 - 311
  • [42] GMSS: Graph-Based Multi-Task Self-Supervised Learning for EEG Emotion Recognition
    Li, Yang
    Chen, Ji
    Li, Fu
    Fu, Boxun
    Wu, Hao
    Ji, Youshuo
    Zhou, Yijin
    Niu, Yi
    Shi, Guangming
    Zheng, Wenming
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (03) : 2512 - 2525
  • [43] Low-rank tensor fusion and self-supervised multi-task multimodal sentiment analysis
    Miao, Xinmeng
    Zhang, Xuguang
    Zhang, Haoran
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (23) : 63291 - 63308
  • [44] SSMTL plus plus : Revisiting self-supervised multi-task learning for video anomaly detection
    Barbalau, Antonio
    Ionescu, Radu Tudor
    Georgescu, Mariana-Iuliana
    Dueholm, Jacob
    Ramachandra, Bharathkumar
    Nasrollahi, Kamal
    Khan, Fahad Shahbaz
    Moeslund, Thomas B.
    Shah, Mubarak
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 229
  • [45] Cross-Domain Self-supervised Multi-task Feature Learning using Synthetic Imagery
    Ren, Zhongzheng
    Lee, Yong Jae
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 762 - 771
  • [46] A Multi-Task Self-Supervised Strategy for Predicting Molecular Properties and FGFR1 Inhibitors
    Yang, Xin
    Wang, Yang
    Lin, Ye
    Zhang, Mingxuan
    Liu, Ou
    Shuai, Jianwei
    Zhao, Qi
    ADVANCED SCIENCE, 2025,
  • [47] Self-supervised Adversarial Multi-task Learning for Vocoder-based Monaural Speech Enhancement
    Du, Zhihao
    Lei, Ming
    Han, Jiqing
    Zhang, Shiliang
    INTERSPEECH 2020, 2020, : 3271 - 3275
  • [48] Pano-SfMLearner: Self-Supervised Multi-Task Learning of Depth and Semantics in Panoramic Videos
    Liu, Mengyi
    Wang, Shuhui
    Guo, Yulan
    He, Yuan
    Xue, Hui
    IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 832 - 836
  • [49] Interinstance and Intratemporal Self-Supervised Learning With Few Labeled Data for Fault Diagnosis
    Hu, Chenye
    Wu, Jingyao
    Sun, Chuang
    Yan, Ruqiang
    Chen, Xuefeng
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (05) : 6502 - 6512
  • [50] Exploiting the potential of unlabeled endoscopic video data with self-supervised learning
    Tobias Ross
    David Zimmerer
    Anant Vemuri
    Fabian Isensee
    Manuel Wiesenfarth
    Sebastian Bodenstedt
    Fabian Both
    Philip Kessler
    Martin Wagner
    Beat Müller
    Hannes Kenngott
    Stefanie Speidel
    Annette Kopp-Schneider
    Klaus Maier-Hein
    Lena Maier-Hein
    International Journal of Computer Assisted Radiology and Surgery, 2018, 13 : 925 - 933