Method for predicting the remaining useful life of mechanical equipment based on deep reinforcement learning

被引:0
|
作者
Zheng G. [1 ]
Zhou Z. [1 ]
Yan R. [1 ]
机构
[1] School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an
关键词
aero-engine; autoencoder; deep learning; reinforcement learning; remaining useful life prediction;
D O I
10.1360/SST-2022-0464
中图分类号
学科分类号
摘要
The reliability and safety of mechanical equipment are increasingly being considered as equipment gets bigger and more complex. The remaining useful life (RUL) prediction technology examines the operating data of the equipment. This technology can effectively enhance the safety and reliability of the operation of the equipment and provide key facts for the subsequent maintenance decisions of the equipment. This paper proposes a deep reinforcement learning-based RUL prediction algorithm. First, the autoencoder (AE) is used to extract key features from the original signals obtained from mechanical equipment. Using the extracted features to form the state variable of reinforcement learning, the reinforcement learning model is trained after setting an appropriate action space and reward function. The sequential interaction decision logic of the reinforcement learning method can naturally maintain the sequential dependence relationship between samples and decrease the volatility of prediction results. Then, the turbine engine data set CMPASS was employed to validate the proposed method. The proposed method is superior to the most current RUL prediction methods in root mean square error and Score, particularly for equipment near the end of degradation. © 2023 Chinese Academy of Sciences. All rights reserved.
引用
收藏
页码:1175 / 1188
页数:13
相关论文
共 30 条
  • [1] Liu X F., The reliability assessment and remaining useful life prediction of rolling bearing based on the LSTM network (in Chinese), pp. 1-2, (2019)
  • [2] Yuan Y, Huang H, Cheng C, Et al., Remaining useful life prediction of the aircraft engine based on the GRU-GAN network with a feature attention mechanism, Sci Sin Tech, 52, pp. 198-212, (2022)
  • [3] Chen Z Q., Research on equipment health assessment and remaining useful life prediction method based on LSTM (in Chinese), pp. 5-6, (2019)
  • [4] Paris P., A critical analysis of crack propagation laws, J Basic Eng, (1963)
  • [5] Ray A, Tangirala S., Stochastic modeling of fatigue crack dynamics for on-line failure prognostics, IEEE Trans Contr Syst Technol, 4, pp. 443-451, (1996)
  • [6] Lei Y G, Li N P, Lin J., A particle filtering-based approach for remaining useful life predication of rolling element bearings, 2014 National Machinery Industry Reliability Technology Academic Exchange Conference, (2014)
  • [7] Fan L, Wang S P, Zhang C, Et al., Life prediction of helicopter planetary carrier plate fatigue crack propagation, J Beijing Univ Aeron Astron, 42, pp. 1927-1935, (2016)
  • [8] Hu Y D, Hu Z Z, Cao S Z., Theoretical study on Manson-Coffin equation for physically short cracks and lifetime prediction, Sci China Tech Sci, 55, pp. 34-42, (2012)
  • [9] Lim P, Goh C K, Tan K C., A time window neural network based framework for remaining useful life estimation, Proceedings of the 2016 International Joint Conference on Neural Networks (IJCNN), (2016)
  • [10] Xia M, Li T, Shu T, Et al., A two-stage approach for the remaining useful life prediction of bearings using deep neural networks, IEEE Trans Ind Inf, 15, pp. 3703-3711, (2019)