A novel deep learning prediction model for concrete dam displacements using interpretable mixed attention mechanism

被引:82
|
作者
Ren, Qiubing [1 ]
Li, Mingchao [1 ]
Li, Heng [2 ]
Shen, Yang [3 ]
机构
[1] Tianjin Univ, State Key Lab Hydraul Engn Simulat & Safety, Tianjin 300350, Peoples R China
[2] Hong Kong Polytech Univ, Dept Bldg & Real Estate, Hong Kong, Peoples R China
[3] China Three Gorges Corp, Beijing 100038, Peoples R China
基金
中国国家自然科学基金;
关键词
Dam displacement prediction; Deep learning; Model interpretability; Long short-term memory network; Attention mechanism; ARTIFICIAL NEURAL-NETWORK; IDENTIFICATION MODEL;
D O I
10.1016/j.aei.2021.101407
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Dam displacements can effectively reflect its operational status, and thus establishing a reliable displacement prediction model is important for dam health monitoring. The majority of the existing data-driven models, however, focus on static regression relationships, which cannot capture the long-term temporal dependencies and adaptively select the most relevant influencing factors to perform predictions. Moreover, the emerging modeling tools such as machine learning (ML) and deep learning (DL) are mostly black-box models, which makes their physical interpretation challenging and greatly limits their practical engineering applications. To address these issues, this paper proposes an interpretable mixed attention mechanism long short-term memory (MAMLSTM) model based on an encoder-decoder architecture, which is formulated in two stages. In the encoder stage, a factor attention mechanism is developed to adaptively select the highly influential factors at each time step by referring to the previous hidden state. In the decoder stage, a temporal attention mechanism is introduced to properly extract the key time segments by identifying the relevant hidden states across all the time steps. For interpretation purpose, our emphasis is placed on the quantification and visualization of factor and temporal attention weights. Finally, the effectiveness of the proposed model is verified using monitoring data collected from a real-world dam, where its accuracy is compared to a classical statistical model, conventional ML models, and homogeneous DL models. The comparison demonstrates that the MAM-LSTM model outperforms the other models in most cases. Furthermore, the interpretation of global attention weights confirms the physical rationality of our attention-based model. This work addresses the research gap in interpretable artificial intelligence for dam displacement prediction and delivers a model with both high-accuracy and interpretability.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] DCAMCP: A deep learning model based on capsule network and attention mechanism for molecular carcinogenicity prediction
    Chen, Zhe
    Zhang, Li
    Sun, Jianqiang
    Meng, Rui
    Yin, Shuaidong
    Zhao, Qi
    [J]. JOURNAL OF CELLULAR AND MOLECULAR MEDICINE, 2023, 27 (20) : 3117 - 3126
  • [42] High-resolution PV power prediction model based on the deep learning and attention mechanism
    Miraftabzadeh, Seyed Mahdi
    Longo, Michela
    [J]. SUSTAINABLE ENERGY GRIDS & NETWORKS, 2023, 34
  • [43] Hybrid Deep Learning Model Integrating Attention Mechanism for the Accurate Prediction and Forecasting of the Cryptocurrency Market
    Saqware G.J.
    Ismail B.
    [J]. Operations Research Forum, 5 (1)
  • [44] Cyanobacteria cell prediction using interpretable deep learning model with observed, numerical, and sensing data assemblage
    Pyo, JongCheol
    Cho, Kyung Hwa
    Kim, Kyunghyun
    Baek, Sang-Soo
    Nam, Gibeom
    Park, Sanghyun
    [J]. WATER RESEARCH, 2021, 203
  • [45] A novel passenger flow prediction model using deep learning methods
    Liu, Lijuan
    Chen, Rung-Ching
    [J]. TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2017, 84 : 74 - 91
  • [46] A Novel Business Process Prediction Model Using a Deep Learning Method
    Mehdiyev N.
    Evermann J.
    Fettke P.
    [J]. Business & Information Systems Engineering, 2020, 62 (2) : 143 - 157
  • [47] A novel prediction based portfolio optimization model using deep learning
    Ma, Yilin
    Wang, Weizhong
    Ma, Qianting
    [J]. COMPUTERS & INDUSTRIAL ENGINEERING, 2023, 177
  • [48] An interpretable deep-learning model for early prediction of sepsis in the emergency department
    Zhang, Dongdong
    Yin, Changchang
    Hunold, Katherine M.
    Jiang, Xiaoqian
    Caterino, Jeffrey M.
    Zhang, Ping
    [J]. PATTERNS, 2021, 2 (02):
  • [49] A novel prediction model for failure mechanism of foamed concrete
    Zhu, Xiangyi
    Lei, Peng
    [J]. CONSTRUCTION AND BUILDING MATERIALS, 2023, 370
  • [50] Development of Biologically Interpretable Multimodal Deep Learning Model for Cancer Prognosis Prediction*
    Azher, Zarif L.
    Vaickus, Louis J.
    Salas, Lucas A.
    Christensen, Brock C.
    Levy, Joshua J.
    [J]. 37TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING, 2022, : 636 - 644