Method for predicting the remaining useful life of mechanical equipment based on deep reinforcement learning

被引:0
|
作者
Zheng G. [1 ]
Zhou Z. [1 ]
Yan R. [1 ]
机构
[1] School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an
关键词
aero-engine; autoencoder; deep learning; reinforcement learning; remaining useful life prediction;
D O I
10.1360/SST-2022-0464
中图分类号
学科分类号
摘要
The reliability and safety of mechanical equipment are increasingly being considered as equipment gets bigger and more complex. The remaining useful life (RUL) prediction technology examines the operating data of the equipment. This technology can effectively enhance the safety and reliability of the operation of the equipment and provide key facts for the subsequent maintenance decisions of the equipment. This paper proposes a deep reinforcement learning-based RUL prediction algorithm. First, the autoencoder (AE) is used to extract key features from the original signals obtained from mechanical equipment. Using the extracted features to form the state variable of reinforcement learning, the reinforcement learning model is trained after setting an appropriate action space and reward function. The sequential interaction decision logic of the reinforcement learning method can naturally maintain the sequential dependence relationship between samples and decrease the volatility of prediction results. Then, the turbine engine data set CMPASS was employed to validate the proposed method. The proposed method is superior to the most current RUL prediction methods in root mean square error and Score, particularly for equipment near the end of degradation. © 2023 Chinese Academy of Sciences. All rights reserved.
引用
收藏
页码:1175 / 1188
页数:13
相关论文
共 30 条
  • [11] Li X, Ding Q, Sun J Q., Remaining useful life estimation in prognostics using deep convolution neural networks, Reliab Eng Syst Saf, 172, pp. 1-11, (2018)
  • [12] Yang B, Liu R, Zio E., Remaining useful life prediction based on a double-convolutional neural network architecture, IEEE Trans Ind Electron, 66, pp. 9521-9530, (2019)
  • [13] Li X, Zhang W, Ding Q., Deep learning-based remaining useful life estimation of bearings using multi-scale feature extraction, Reliab Eng Syst Saf, 182, pp. 208-218, (2019)
  • [14] Elsheikh A, Yacout S, Ouali M S., Bidirectional handshaking LSTM for remaining useful life prediction, Neurocomputing, 323, pp. 148-156, (2019)
  • [15] Huang C G, Huang H Z, Li Y F., A bidirectional LSTM prognostics method under multiple operational conditions, IEEE Trans Ind Electron, 66, pp. 8792-8802, (2019)
  • [16] Al-Dulaimi A, Zabihi S, Asif A, Et al., Hybrid deep neural network model for remaining useful life estimation, Proceedings of the ICASSP 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), (2019)
  • [17] Zhang C, Lim P, Qin A K, Et al., Multiobjective deep belief networks ensemble for remaining useful life estimation in prognostics, IEEE Trans Neural Netw Learn Syst, 28, pp. 2306-2318, (2017)
  • [18] Mo Y, Wu Q, Li X, Et al., Remaining useful life estimation via transformer encoder enhanced by a gated convolutional unit, J Intell Manuf, 32, pp. 1997-2006, (2021)
  • [19] Lei Y, Yang B, Jiang X, Et al., Applications of machine learning to machine fault diagnosis: A review and roadmap, Mech Syst Signal Proc, 138, (2020)
  • [20] Lei Y, Li N, Guo L, Et al., Machinery health prognostics: A systematic review from data acquisition to RUL prediction, Mech Syst Signal Proc, 104, pp. 799-834, (2018)