A novel deep learning prediction model for concrete dam displacements using interpretable mixed attention mechanism

被引:82
|
作者
Ren, Qiubing [1 ]
Li, Mingchao [1 ]
Li, Heng [2 ]
Shen, Yang [3 ]
机构
[1] Tianjin Univ, State Key Lab Hydraul Engn Simulat & Safety, Tianjin 300350, Peoples R China
[2] Hong Kong Polytech Univ, Dept Bldg & Real Estate, Hong Kong, Peoples R China
[3] China Three Gorges Corp, Beijing 100038, Peoples R China
基金
中国国家自然科学基金;
关键词
Dam displacement prediction; Deep learning; Model interpretability; Long short-term memory network; Attention mechanism; ARTIFICIAL NEURAL-NETWORK; IDENTIFICATION MODEL;
D O I
10.1016/j.aei.2021.101407
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Dam displacements can effectively reflect its operational status, and thus establishing a reliable displacement prediction model is important for dam health monitoring. The majority of the existing data-driven models, however, focus on static regression relationships, which cannot capture the long-term temporal dependencies and adaptively select the most relevant influencing factors to perform predictions. Moreover, the emerging modeling tools such as machine learning (ML) and deep learning (DL) are mostly black-box models, which makes their physical interpretation challenging and greatly limits their practical engineering applications. To address these issues, this paper proposes an interpretable mixed attention mechanism long short-term memory (MAMLSTM) model based on an encoder-decoder architecture, which is formulated in two stages. In the encoder stage, a factor attention mechanism is developed to adaptively select the highly influential factors at each time step by referring to the previous hidden state. In the decoder stage, a temporal attention mechanism is introduced to properly extract the key time segments by identifying the relevant hidden states across all the time steps. For interpretation purpose, our emphasis is placed on the quantification and visualization of factor and temporal attention weights. Finally, the effectiveness of the proposed model is verified using monitoring data collected from a real-world dam, where its accuracy is compared to a classical statistical model, conventional ML models, and homogeneous DL models. The comparison demonstrates that the MAM-LSTM model outperforms the other models in most cases. Furthermore, the interpretation of global attention weights confirms the physical rationality of our attention-based model. This work addresses the research gap in interpretable artificial intelligence for dam displacement prediction and delivers a model with both high-accuracy and interpretability.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Interpretable deep learning model for building energy consumption prediction based on attention mechanism
    Gao, Yuan
    Ruan, Yingjun
    [J]. ENERGY AND BUILDINGS, 2021, 252
  • [2] Interpretable Deep Learning Prediction Model for Compressive Strength of Concrete
    混凝土抗压强度的可解释深度学习预测模型
    [J]. Wang, Hui-Ming (wanghmxj@126.com), 1600, Northeast University (45):
  • [3] A Novel Interpretable Deep Learning Model for Ozone Prediction
    Chen, Xingguo
    Li, Yang
    Xu, Xiaoyan
    Shao, Min
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (21):
  • [4] AIST: An Interpretable Attention-Based Deep Learning Model for Crime Prediction
    Rayhan, Yeasir
    Hashem, Tanzima
    [J]. ACM TRANSACTIONS ON SPATIAL ALGORITHMS AND SYSTEMS, 2023, 9 (02)
  • [5] Interpretable single-cell transcription factor prediction based on deep learning with attention mechanism
    Gong, Meiqin
    He, Yuchen
    Wang, Maocheng
    Zhang, Yongqing
    Ding, Chunli
    [J]. COMPUTATIONAL BIOLOGY AND CHEMISTRY, 2023, 106
  • [6] Multi-block synchronous prediction of concrete dam displacements using MIMO machine learning paradigm
    Ren, Qiubing
    Li, Heng
    Zheng, Xiazhong
    Li, Mingchao
    Xiao, Lei
    Kong, Ting
    [J]. ADVANCED ENGINEERING INFORMATICS, 2023, 55
  • [7] Deep learning pan-specific model for interpretable MHC-I peptide binding prediction with improved attention mechanism
    Jin, Jing
    Liu, Zhonghao
    Nasiri, Alireza
    Cui, Yuxin
    Louis, Stephen-Yves
    Zhang, Ansi
    Zhao, Yong
    Hu, Jianjun
    [J]. PROTEINS-STRUCTURE FUNCTION AND BIOINFORMATICS, 2021, 89 (07) : 866 - 883
  • [8] Analysis of slope stochastic fields using a novel deep learning model with attention mechanism
    Ma, Ning
    Yao, Zaizhen
    [J]. FRONTIERS IN EARTH SCIENCE, 2024, 12
  • [9] A Concrete Dam Deformation Prediction Method Based on LSTM With Attention Mechanism
    Yang, Dashan
    Gu, Chongshi
    Zhu, Yantao
    Dai, Bo
    Zhang, Kang
    Zhang, Zhiduan
    Li, Bo
    [J]. IEEE ACCESS, 2020, 8 : 185177 - 185186
  • [10] A Deep Learning Model for Concrete Dam Deformation Prediction Based on RS-LSTM
    Qu, Xudong
    Yang, Jie
    Chang, Meng
    [J]. JOURNAL OF SENSORS, 2019, 2019