Dynamic soft sensor algorithm based on nonnegative garrote and long short-term memory neural network

被引:0
|
作者
Sun K. [1 ]
Sui L. [1 ]
Zhang F.-F. [1 ]
Yang G.-K. [2 ,3 ]
机构
[1] School of Electrical Engineering and Automation, Qilu University of Technology, Shandong Academy of Sciences, Shandong, Jinan
[2] Department of Automation, Shanghai Jiaotong University, Shanghai
[3] Ningbo Institute of Artificial Intelligence, Shanghai Jiaotong University, Zhejiang, Ningbo
关键词
dynamic modeling; long short-term memory; model reduction; neural networks; soft sensor; variable selection;
D O I
10.7641/CTA.2021.10529
中图分类号
学科分类号
摘要
In modern industrial process modeling, the multivariable, nonlinearity and dynamics of the production process increase the model complexity and reduce the model accuracy. In response to this problem, a dynamic soft-sensing algorithm based on the long short-term memory (LSTM) neural network and its input variable selection is proposed by embedding the nonnegative garrote (NNG) into the LSTM neural network. First, a well-trained LSTM neural network is generated with parameter optimization, in which the dynamics and time-delay of industrial processes are handled by its excellent memory capacity of historical information. Then, the NNG algorithm is used to compress the input weights of the LSTM network to eliminate the redundant variables and improve the model accuracy. Grid search and blocked cross-validation are used to find the optimal hyperparameter of the algorithm. Finally, the algorithm is applied to the soft-sensing modeling of SO2 concentration in the flue gas that is discharged from the desulfurization process of a thermal power plant, and the performance of the algorithm is compared with other state-of-the-art algorithms. Experimental results demonstrate that the proposed algorithm can effectively delete the redundant variables, reduce the model complexity and improve the prediction performance of the model. © 2023 South China University of Technology. All rights reserved.
引用
收藏
页码:83 / 93
页数:10
相关论文
共 27 条
  • [1] YUAN X, WANG Y, YANG C, Et al., Weighted linear dynamic system for feature representation and soft sensor application in nonlinear dynamic industrial processes, IEEE Transactions on Industrial Electronics, 65, 2, pp. 1508-1517, (2017)
  • [2] TANG Jian, QIAO Junfei, XU Zhe, Et al., Soft measuring approach of dioxin emission concentration in municipal solid waste incineration process based on feature reduction and selective ensemble algorithm, Control Theory & Applications, 38, 1, pp. 110-120, (2021)
  • [3] LIU Y, CHEN T, CHEN J., Auto-switch Gaussian process regression-based probabilistic soft sensors for industrial multigrade processes with transitions, Industrial & Engineering Chemistry Research, 54, 18, pp. 5037-5047, (2015)
  • [4] GENG Zhiqiang, XU Meng, ZHU Qunxiong, Et al., Research and application of soft measurement model for complex chemical processes based on deep learning, CIESC Journal, 70, 2, pp. 564-571, (2019)
  • [5] SUN K, HUANG S H, WONG D S H, Et al., Design and application of a variable selection method for multilayer perceptron neural network with LASSO, IEEE Transactions on Neural Networks and Learning Systems, 28, 6, pp. 1386-1396, (2016)
  • [6] WU Weining, LIU Xiaoyan, XU Xuekui, Et al., Time series analysis method for the soft measurement of cement clinker quality, Control Theory & Applications, 35, 7, pp. 1029-1036, (2018)
  • [7] JI Yuehui, ZHOU Hailiang, CHE Shihang, Et al., Recurrent neural network-based optimal attitude control of reentry vehicle, Control Theory & Applications, 38, 3, pp. 329-338, (2021)
  • [8] BENGIO Y, SIMARD P, FRASCONI P., Learning long-term dependencies with gradient descent is difficult, IEEE Transactions on Neural Networks, 5, 2, pp. 157-166, (1994)
  • [9] HOCHREITER S, SCHMIDHUBER J., Long short-term memory, Neural Computation, 9, 8, pp. 1735-1780, (1997)
  • [10] LIU J, WANG G, DUAN L Y, Et al., Skeleton-based human action recognition with global context-aware attention LSTM networks, IEEE Transactions on Image Processing, 27, 4, pp. 1586-1599, (2017)