A Hydrological Data Prediction Model Based on LSTM with Attention Mechanism

被引:10
|
作者
Dai, Zhihui [1 ]
Zhang, Ming [2 ]
Nedjah, Nadia [3 ]
Xu, Dong [4 ]
Ye, Feng [1 ]
机构
[1] Hohai Univ, Sch Comp & Informat, Nanjing 211100, Peoples R China
[2] Water Resources Dept Jiangsu Prov, Nanjing 210029, Peoples R China
[3] Univ Estado Rio De Janeiro, Engn Fac, Dept Elect Engn & Telecommun, BR-20550013 Rio De Janeiro, Brazil
[4] Hohai Univ, Coll Water Conservancy & Hydropower Engn, Nanjing 211100, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
seq2seq model; attention mechanism; LSTM model; hydrological prediction; feature analysis; SHORT-TERM-MEMORY;
D O I
10.3390/w15040670
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
With the rapid development of IoT, big data and artificial intelligence, the research and application of data-driven hydrological models are increasing. However, when conducting time series analysis, many prediction models are often directly based on the following assumptions: hydrologic time series are normal, homogeneous, smooth and non-trending, which are not always all true. To address the related issues, a solution for short-term hydrological forecasting is proposed. Firstly, a feature test is conducted to verify whether the hydrological time series are normal, homogeneous, smooth and non-trending; secondly, a sequence-to-sequence (seq2seq)-based short-term water level prediction model (LSTM-seq2seq) is proposed to improve the accuracy of hydrological prediction. The model uses a long short-term memory neural network (LSTM) as an encoding layer to encode the historical flow sequence into a context vector, and another LSTM as a decoding layer to decode the context vector in order to predict the target runoff, by superimposing on the attention mechanism, aiming at improving the prediction accuracy. Using the experimental data regarding the water level of the Chu River, the model is compared to other models based on the analysis of normality, smoothness, homogeneity and trending of different water level data. The results show that the prediction accuracy of the proposed model is greater than that of the data set without these characteristics for the data set with normality, smoothness, homogeneity and trend. Flow data at Runcheng, Wuzhi, Baima Temple, Longmen Town, Dongwan, Lu's and Tongguan are used as input data sets to train and evaluate the model. Metrics RMSE and NSE are used to evaluate the prediction accuracy and convergence speed of the model. The results show that the prediction accuracy of LSTM-seq2seq and LSTM-BP models is higher than other models. Furthermore, the convergence process of the LSTM-seq2seq model is the fastest among the compared models.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Hydrological Time Series Prediction Model Based on Attention-LSTM Neural Network
    Li, Yiran
    Yang, Juan
    PROCEEDINGS OF THE 2019 2ND INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND MACHINE INTELLIGENCE (MLMI 2019), 2019, : 21 - 25
  • [2] LSTM Road Traffic Accident Prediction Model Based on Attention Mechanism
    Wang, Shunshun
    Yan, Changshun
    Shao, Yong
    2023 8TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA ANALYTICS, ICCCBDA, 2023, : 215 - 219
  • [3] Electricity consumption prediction based on LSTM with attention mechanism
    Lin, Zhifeng
    Cheng, Lianglun
    Huang, Guoheng
    IEEJ TRANSACTIONS ON ELECTRICAL AND ELECTRONIC ENGINEERING, 2020, 15 (04) : 556 - 562
  • [4] LSTM WASTEWATER QUALITY PREDICTION BASED ON ATTENTION MECHANISM
    Wang, Xiao-Feng
    Wei, Sheng-Nan
    Xu, Li-Xiang
    Pan, Jun
    Wu, Zhi-Ze
    Kwong, Timothy C. H.
    Tang, Yuan-Yan
    PROCEEDINGS OF 2021 INTERNATIONAL CONFERENCE ON WAVELET ANALYSIS AND PATTERN RECOGNITION (ICWAPR), 2021, : 48 - 53
  • [5] Time Series Prediction Based on LSTM-Attention-LSTM Model
    Wen, Xianyun
    Li, Weibang
    IEEE ACCESS, 2023, 11 : 48322 - 48331
  • [6] A Power Load Prediction by LSTM Model Based on the Double Attention Mechanism for Hospital Building
    FENG Zengxi
    GE Xun
    ZHOU Yaojia
    LI Jiale
    Wuhan University Journal of Natural Sciences, 2023, 28 (03) : 223 - 236
  • [7] A watershed water quality prediction model based on attention mechanism and Bi-LSTM
    Qiang Zhang
    Ruiqi Wang
    Ying Qi
    Fei Wen
    Environmental Science and Pollution Research, 2022, 29 : 75664 - 75680
  • [8] A watershed water quality prediction model based on attention mechanism and Bi-LSTM
    Zhang, Qiang
    Wang, Ruiqi
    Qi, Ying
    Wen, Fei
    ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH, 2022, 29 (50) : 75664 - 75680
  • [9] Prediction of Hot Topics of Agricultural Public Opinion Based on Attention Mechanism LSTM Model
    Fu, Lifang
    Zhao, Feifei
    INTERNATIONAL JOURNAL OF AGRICULTURAL AND ENVIRONMENTAL INFORMATION SYSTEMS, 2021, 12 (04)
  • [10] A stream prediction model based on attention-LSTM
    Yan, Le
    Chen, Changwei
    Hang, Tingting
    Hu, Youchuan
    EARTH SCIENCE INFORMATICS, 2021, 14 (02) : 723 - 733