CNN-BiLSTM hybrid neural networks with attention mechanism for well log prediction

被引:69
|
作者
Shan, Liqun [1 ]
Liu, Yanchang [1 ]
Tang, Min [1 ]
Yang, Ming [2 ]
Bai, Xueyuan [1 ]
机构
[1] Northeast Petr Univ, Daqing, Peoples R China
[2] Westfield State Univ, Westfield, MA USA
关键词
Well logs; CNN; BiLSTM; Attention mechanism; Prediction; BIDIRECTIONAL LSTM; MODEL;
D O I
10.1016/j.petrol.2021.108838
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Well logging is a significant method of formation description and resource assessment in exploration and development of oil, natural gas, minerals, groundwater, and sub-surface thermal energy, as well as geotechnical engineering and environmental research. However, the shortage problem of well logging data always exists because well logs can only be measured through a drilling process involving costly and time-consuming field trials. To address this issue, bidirectional long short-term memory (BiLSTM), attention mechanism, and convolutional neural network (CNN) were coupled to build hybrid neural networks for predicting missing well logs. The proposed architecture is a structure of two branches. One branch uses CNN to capture the spatial properties of well logs, and the other one conducts the feature selections by utilizing two-layer BiLSTM with attention mechanism. The spatio-temporal correlations from two branches are merged to forecast the target well logs. The performance of the proposed method is evaluated within a highly heterogeneous reservoir at the Gangdong oilfield in China. In our experiments, six models were trained and used for generating synthetic well logs including compensated neutron logs (CNL), acoustic (AC), spontaneous potential (SP), gamma-ray (GR), density (DEN), and formation resistivity (RT). Moreover, traditional machine learning models, CNN, BiLSTM, and other deep learning benchmark models were developed to compare with the presented models. Results show that the proposed method achieves higher prediction accuracy because it takes into account the spatio-temporal information of well logs.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] A CNN-BiLSTM model with attention mechanism for earthquake prediction
    Kavianpour, Parisa
    Kavianpour, Mohammadreza
    Jahani, Ehsan
    Ramezani, Amin
    [J]. JOURNAL OF SUPERCOMPUTING, 2023, 79 (17): : 19194 - 19226
  • [2] A CNN-BiLSTM model with attention mechanism for earthquake prediction
    Parisa Kavianpour
    Mohammadreza Kavianpour
    Ehsan Jahani
    Amin Ramezani
    [J]. The Journal of Supercomputing, 2023, 79 : 19194 - 19226
  • [3] Correction to: A CNN-BiLSTM model with attention mechanism for earthquake prediction
    Parisa Kavianpour
    Mohammadreza Kavianpour
    Ehsan Jahani
    Amin Ramezani
    [J]. The Journal of Supercomputing, 2024, 80 : 2913 - 2913
  • [4] Prediction of Battery SOH by CNN-BiLSTM Network Fused with Attention Mechanism
    Sun, Shuo
    Sun, Junzhong
    Wang, Zongliang
    Zhou, Zhiyong
    Cai, Wei
    [J]. ENERGIES, 2022, 15 (12)
  • [5] PM2.5 Concentration Prediction Based on CNN-BiLSTM and Attention Mechanism
    Zhang, Jinsong
    Peng, Yongtao
    Ren, Bo
    Li, Taoying
    [J]. ALGORITHMS, 2021, 14 (07)
  • [6] AN IMPROVED CROP YIELD PREDICTION USING CNN-BILSTM MODEL WITH ATTENTION MECHANISM
    Jia, Zhaohong
    Wu, Kunming
    Wang, Haitao
    Zeng, Weihui
    Guo, YangYang
    Liang, Dong
    [J]. Journal of the ASABE, 2024, 67 (06): : 1459 - 1467
  • [7] A Prediction Method of Consumer Buying Behavior Based on Attention Mechanism and CNN-BiLSTM
    Wang, Jian-Nan
    Cui, Jian-Feng
    Chen, Chin-Ling
    [J]. Journal of Network Intelligence, 2022, 7 (02): : 375 - 385
  • [8] Low-orbit satellite channel prediction algorithm based on the hybrid CNN-BiLSTM using attention mechanism
    Tang, Yiqiang
    Yang, Xiaopeng
    Zhu, Shengming
    [J]. Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2022, 44 (12): : 3863 - 3870
  • [9] Remaining Useful Life Prediction of Milling Cutters Based on CNN-BiLSTM and Attention Mechanism
    Nie, Lei
    Zhang, Lvfan
    Xu, Shiyi
    Cai, Wentao
    Yang, Haoming
    [J]. SYMMETRY-BASEL, 2022, 14 (11):
  • [10] An Improved Facial Expression Recognition using CNN-BiLSTM with Attention Mechanism
    Jayaraman, Samanthisvaran
    Mahendran, Anand
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (05) : 1307 - 1315