Mining knowledge from unlabeled data for fault diagnosis: A multi-task self-supervised approach

被引:5
|
作者
Kong, Depeng [1 ]
Huang, Weidi [1 ]
Zhao, Libo [2 ]
Ding, Jianjun [2 ]
Wu, Haiteng [3 ,4 ]
Yang, Geng [1 ,4 ]
机构
[1] Zhejiang Univ, Sch Mech Engn, State Key Lab Fluid Power & Mechatron Syst, Hangzhou 310027, Zhejiang, Peoples R China
[2] Xi An Jiao Tong Univ, Sch Mech Engn, State Key Lab Mfg Syst Engn, Xian 710049, Shaanxi, Peoples R China
[3] Hangzhou Shenhao Technol Co Ltd, Hangzhou 311100, Zhejiang, Peoples R China
[4] Zhejiang Key Lab Intelligent Operat & Maintenance, Hangzhou 311100, Zhejiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Fault diagnosis; Knowledge mining; Knowledge transfer; Self-supervised learning; NEURAL-NETWORK; AUTOENCODER; BEARINGS; MACHINE; CNN;
D O I
10.1016/j.ymssp.2024.111189
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
Deep learning -assisted fault diagnosis has achieved significant success in recent years due to its capability of automatic feature learning and intelligent decision -making. Nonetheless, supervised methods are limited by their demands for annotations and fail to explore the growing unlabeled data generated by monitoring devices. An urgent need arises for an efficient approach to utilizing massive unlabeled data to facilitate fault diagnosis. However, existing unsupervised approaches usually rely on a single task for representation learning and lack the synergistic consideration of the cooperation of multiple tasks. To this end, a multi -task self -supervised approach is proposed to comprehensively mine diagnostic knowledge from unlabeled data. Three self -supervised tasks, namely Contrastive similarity matching, Pseudo Label predicting, and Intra-sample temporal relation reasoning (CPLI), are designed to learn representations of vibration signals at inter -instance, instance, and inner -instance levels, respectively. They are meticulously designed and combined to work corporately. The first task focuses on estimating similarities among pairs of augmented samples, while the second task helps this process by guiding the model to identify augmentation methods. As an important complement, the third task delves into the temporal relations among pieces of a time series. Three case studies demonstrate the superiority of the CPLI over state-of-the-art methods in terms of domain adaptability and diagnostic accuracy. These findings highlight its potential for leveraging unlabeled monitoring data to benefit fault diagnosis.
引用
收藏
页数:20
相关论文
共 50 条
  • [21] MULTI-TASK SELF-SUPERVISED PRE-TRAINING FOR MUSIC CLASSIFICATION
    Wu, Ho-Hsiang
    Kao, Chieh-Chi
    Tang, Qingming
    Sun, Ming
    McFee, Brian
    Bello, Juan Pablo
    Wang, Chao
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 556 - 560
  • [22] Multi-task self-supervised time-series representation learning
    Choi, Heejeong
    Kang, Pilsung
    INFORMATION SCIENCES, 2024, 671
  • [23] Exploring multi-task learning and data augmentation in dementia detection with self-supervised pretrained models
    Chen, Minchuan
    Miao, Chenfeng
    Ma, Jun
    Wang, Shaojun
    Xiao, Jing
    INTERSPEECH 2023, 2023, : 5037 - 5041
  • [24] Self-Supervised Simple Siamese Framework for Fault Diagnosis of Rotating Machinery With Unlabeled Samples
    Wan, Wenqing
    Chen, Jinglong
    Zhou, Zitong
    Shi, Zhen
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (05) : 6380 - 6392
  • [25] Transformer encoder based self-supervised learning for HVAC fault detection with unlabeled data
    Abdollah, M. A. F.
    Scoccia, R.
    Aprile, M.
    BUILDING AND ENVIRONMENT, 2024, 258
  • [26] SSentiA: A Self-supervised Sentiment Analyzer for classification from unlabeled data
    Sazzed, Salim
    Jayarathna, Sampath
    MACHINE LEARNING WITH APPLICATIONS, 2021, 4
  • [27] A Multi-Task Dense Network with Self-Supervised Learning for Retinal Vessel Segmentation
    Tu, Zhonghao
    Zhou, Qian
    Zou, Hua
    Zhang, Xuedong
    ELECTRONICS, 2022, 11 (21)
  • [28] Self-supervised Contrastive Learning Approach for Bearing Fault Diagnosis with Rare Labeled Data
    Chen, Jianghai
    Yang, Boyuan
    Liu, Ruonan
    2022 IEEE 31ST INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS (ISIE), 2022, : 1190 - 1194
  • [29] MULTI-TASK SELF-SUPERVISED VISUAL REPRESENTATION LEARNING FOR MONOCULAR ROAD SEGMENTATION
    Cho, Jaehoon
    Kim, Youngjung
    Jung, Hyungjoo
    Oh, Changjae
    Youn, Jaesung
    Sohn, Kwanghoon
    2018 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2018,
  • [30] scPretrain: multi-task self-supervised learning for cell-type classification
    Zhang, Ruiyi
    Luo, Yunan
    Ma, Jianzhu
    Zhang, Ming
    Wang, Sheng
    BIOINFORMATICS, 2022, 38 (06) : 1607 - 1614