Mining knowledge from unlabeled data for fault diagnosis: A multi-task self-supervised approach

被引:5
|
作者
Kong, Depeng [1 ]
Huang, Weidi [1 ]
Zhao, Libo [2 ]
Ding, Jianjun [2 ]
Wu, Haiteng [3 ,4 ]
Yang, Geng [1 ,4 ]
机构
[1] Zhejiang Univ, Sch Mech Engn, State Key Lab Fluid Power & Mechatron Syst, Hangzhou 310027, Zhejiang, Peoples R China
[2] Xi An Jiao Tong Univ, Sch Mech Engn, State Key Lab Mfg Syst Engn, Xian 710049, Shaanxi, Peoples R China
[3] Hangzhou Shenhao Technol Co Ltd, Hangzhou 311100, Zhejiang, Peoples R China
[4] Zhejiang Key Lab Intelligent Operat & Maintenance, Hangzhou 311100, Zhejiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Fault diagnosis; Knowledge mining; Knowledge transfer; Self-supervised learning; NEURAL-NETWORK; AUTOENCODER; BEARINGS; MACHINE; CNN;
D O I
10.1016/j.ymssp.2024.111189
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
Deep learning -assisted fault diagnosis has achieved significant success in recent years due to its capability of automatic feature learning and intelligent decision -making. Nonetheless, supervised methods are limited by their demands for annotations and fail to explore the growing unlabeled data generated by monitoring devices. An urgent need arises for an efficient approach to utilizing massive unlabeled data to facilitate fault diagnosis. However, existing unsupervised approaches usually rely on a single task for representation learning and lack the synergistic consideration of the cooperation of multiple tasks. To this end, a multi -task self -supervised approach is proposed to comprehensively mine diagnostic knowledge from unlabeled data. Three self -supervised tasks, namely Contrastive similarity matching, Pseudo Label predicting, and Intra-sample temporal relation reasoning (CPLI), are designed to learn representations of vibration signals at inter -instance, instance, and inner -instance levels, respectively. They are meticulously designed and combined to work corporately. The first task focuses on estimating similarities among pairs of augmented samples, while the second task helps this process by guiding the model to identify augmentation methods. As an important complement, the third task delves into the temporal relations among pieces of a time series. Three case studies demonstrate the superiority of the CPLI over state-of-the-art methods in terms of domain adaptability and diagnostic accuracy. These findings highlight its potential for leveraging unlabeled monitoring data to benefit fault diagnosis.
引用
收藏
页数:20
相关论文
共 50 条
  • [31] Learning Representations for Bipartite Graphs Using Multi-task Self-supervised Learning
    Sethi, Akshay
    Gupta, Sonia
    Malhotra, Aakarsh
    Asthana, Siddhartha
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, ECML PKDD 2023, PT III, 2023, 14171 : 19 - 35
  • [32] Multi-task self-supervised learning based fusion representation for Multi-view clustering
    Guo, Tianlong
    Shen, Derong
    Kou, Yue
    Nie, Tiezheng
    INFORMATION SCIENCES, 2025, 694
  • [33] Multi-task ordinal regression with labeled and unlabeled data
    Xiao, Yanshan
    Zhang, Liangwang
    Liu, Bo
    Cai, Ruichu
    Hao, Zhifeng
    INFORMATION SCIENCES, 2023, 649
  • [34] Multi-Task Collaborative Network: Bridge the Supervised and Self-Supervised Learning for EEG Classification in RSVP Tasks
    Li, Hongxin
    Tang, Jingsheng
    Li, Wenqi
    Dai, Wei
    Liu, Yaru
    Zhou, Zongtan
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2024, 32 : 638 - 651
  • [35] Modeling Alzheimers' Disease Progression from Multi-task and Self-supervised Learning Perspective with Brain Networks
    Liang, Wei
    Zhang, Kai
    Cao, Peng
    Zhao, Pengfei
    Liu, Xiaoli
    Yang, Jinzhu
    Zaiane, Osmar R.
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT I, 2023, 14220 : 310 - 319
  • [36] MT-SLVR: Multi-Task Self-Supervised Learning for Transformation In(Variant) Representations
    Heggan, Calum
    Hospedales, Tim
    Budgett, Sam
    Yaghoobi, Mehrdad
    INTERSPEECH 2023, 2023, : 4399 - 4403
  • [37] TacoPrompt: A Collaborative Multi-Task Prompt Learning Method for Self-Supervised Taxonomy Completion
    Xu, Hongyuan
    Liu, Ciyi
    Niu, Yuhang
    Chen, Yunong
    Cai, Xiangrui
    Wen, Yanlong
    Yuan, Xiaojie
    2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2023), 2023, : 15804 - 15817
  • [38] Multi-task Self-supervised Object Detection via Recycling of Bounding Box Annotations
    Lee, Wonhee
    Na, Joonil
    Kim, Gunhee
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 4979 - 4988
  • [39] ConvMTL: Multi-task Learning via Self-supervised Learning for Simultaneous Dense Predictions
    Iyer, Vijayasri
    Thangavel, Senthil Kumar
    Nalluri, Madhusudana Rao
    Chang, Maiga
    COMPUTER VISION AND IMAGE PROCESSING, CVIP 2023, PT I, 2024, 2009 : 455 - 466
  • [40] Exploiting Unlabeled Data in CNNs by Self-Supervised Learning to Rank
    Liu, Xialei
    van de Weijer, Joost
    Bagdanov, Andrew D.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (08) : 1862 - 1878