A lightweight transformer and depthwise separable convolution model for remaining useful life prediction of turbofan engines

被引:4
|
作者
Li, Rongzhang [1 ]
Zhan, Hongfei [1 ]
Yu, Junhe [1 ]
Wang, Rui [1 ]
Han, Kang [1 ]
机构
[1] Ningbo Univ, Coll Mech Engn & Mech, Ningbo 315211, Peoples R China
关键词
turbofan engines; RUL prediction; multiple operating conditions; Transformer; probsparse attention mechanism;
D O I
10.1088/1361-6501/ad0ad5
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The degradation of turbofan engines under complex operating conditions makes it difficult to predict their remaining useful life (RUL), which affects aircraft maintenance efficiency and reliability. To maintain prediction accuracy while improving prediction speed under the limited computing power and memory resources of edge devices, a lightweight Transformer and depthwise separable convolutional neural network (DSCformer) prediction model has been proposed. In the proposed DSCformer method, a probsparse self-attention mechanism with convolutional transformation of the Value branch is developed to improve the efficiency of dot-product, and depthwise separable convolution is employed to extract local spatiotemporal features replace the decoder in Transformer. Additionally, the model's ability to capture overall trends is improved by incorporating a scaling factor in the Bayesian optimization algorithm, which also accelerates the search for the smoothing coefficient. The evaluation on the C-MAPSS dataset shows that the proposed method achieves a root mean square error of 11.33 and 12.44, as well as scores of 634.22 and 947.35 for predicting FD002 and FD004, respectively, within a shorter training time. These results indicate that the proposed method outperforms state-of-the-art prediction methods under multiple operating conditions for aero engine RUL prediction.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Convolution-Graph Attention Network With Sensor Embeddings for Remaining Useful Life Prediction of Turbofan Engines
    Chen, Xiao
    Zeng, Ming
    [J]. IEEE SENSORS JOURNAL, 2023, 23 (14) : 15786 - 15794
  • [2] TinyML-based approach for Remaining Useful Life Prediction of Turbofan Engines
    Athanasakis, Georgios
    Filios, Gabriel
    Katsidimas, Ioannis
    Nikoletseas, Sotiris
    Panagiotou, Stefanos H.
    [J]. 2022 IEEE 27TH INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2022,
  • [3] Using transformer and a reweighting technique to develop a remaining useful life estimation method for turbofan engines
    Kim, Gyeongho
    Choi, Jae Gyeong
    Lim, Sunghoon
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 133
  • [4] Load Prediction Based on Depthwise Separable Convolution Model
    Zhang, Kui
    Zhai, Suwei
    Lu, Hai
    [J]. 2021 4TH INTERNATIONAL CONFERENCE ON MECHATRONICS, ROBOTICS AND AUTOMATION (ICMRA 2021), 2020, : 75 - 79
  • [5] Fault Prognosis of Turbofan Engines: Eventual Failure Prediction and Remaining Useful Life Estimation
    Cohen, Joseph
    Huan, Xun
    Ni, Jun
    [J]. INTERNATIONAL JOURNAL OF PROGNOSTICS AND HEALTH MANAGEMENT, 2023, 14 (02)
  • [6] Falcon: lightweight and accurate convolution based on depthwise separable convolution
    Jang, Jun-Gi
    Quan, Chun
    Lee, Hyun Dong
    Kang, U.
    [J]. KNOWLEDGE AND INFORMATION SYSTEMS, 2023, 65 (05) : 2225 - 2249
  • [7] Prediction of remaining useful life of turbofan engine based on optimized model
    Liu, Yuefeng
    Zhang, Xiaoyan
    Guo, Wei
    Bian, Haodong
    He, Yingjie
    Liu, Zhen
    [J]. 2021 IEEE 20TH INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS (TRUSTCOM 2021), 2021, : 1473 - 1477
  • [8] Falcon: lightweight and accurate convolution based on depthwise separable convolution
    Jun-Gi Jang
    Chun Quan
    Hyun Dong Lee
    U. Kang
    [J]. Knowledge and Information Systems, 2023, 65 : 2225 - 2249
  • [9] Remaining Useful Life Prediction of Turbofan Engines Using CNN-LSTM-SAM Approach
    Li, Jie
    Jia, Yuanjie
    Niu, Mingbo
    Zhu, Wei
    Meng, Fanxi
    [J]. IEEE SENSORS JOURNAL, 2023, 23 (09) : 10241 - 10251
  • [10] Prediction of Remaining Useful Life Using Fused Deep Learning Models: A Case Study of Turbofan Engines
    Zheng, Yu
    Bao, Xiangyu
    Zhao, Fei
    Chen, Chong
    Liu, Ying
    Sun, Bo
    Wang, Haotong
    [J]. JOURNAL OF COMPUTING AND INFORMATION SCIENCE IN ENGINEERING, 2022, 22 (05)