Reservoir fluid identification based on multi-head attention with UMAP

被引:0
|
作者
Hua, Yuanpeng [1 ]
Gao, Guozhong [2 ]
He, Daxiang [3 ]
Wang, Gang [4 ]
Liu, Wenjun [5 ]
机构
[1] Yangtze Univ, Coll Geophys & Petr Resources, Wuhan 430100, Hubei, Peoples R China
[2] Southwest Petr Univ, Sch Geosci & Technol, Chengdu 610500, Peoples R China
[3] Yangtze Univ, Coll Resources & Environm, Wuhan 430100, Hubei, Peoples R China
[4] CNPC Bohai Drilling Engn Co Ltd, Tianjin 300457, Peoples R China
[5] CNPC Logging Co Ltd, Changqing Div, Xian 710201, Shanxi, Peoples R China
来源
关键词
Gas logging; Fluid identification; Transformer; Deep learning; Symbolic Aggregate approXimation (SAX); UMAP; Dimensionality reduction; Multi -head attention mechanism; REPRESENTATION;
D O I
10.1016/j.geoen.2024.212888
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Gas logging curves obtained during drilling, along with conventional well logs, typically serve as foundational data for identifying reservoir fluids. Traditional methods for identifying layers containing oil or gas often suffer from limitations such as inadequate feature extraction, underutilization of differences in data points, and limited applicability. These limitations lead to reduced accuracy in predicting reservoir fluid segmentation. To address the challenge of spatiotemporal feature extraction in logging curves, this paper presents a fluid identification method based on deep learning networks and multivariate sequence classification. The method takes into account both the sequential variations in geological strata and the relationships among different curves for fluid prediction. Our proposed method utilizes a Transformer multi-head attention mechanism and follows a series of steps. First, an improved Symbolic Aggregate approXimation (SAX) is employed to assess the response characteristics of the logging curves to the target fluid and identify sensitive curves based on information similarity. Subsequently, the semi-supervised learning method UMAP is applied to identify layers with high interpretability. Hierarchical training is then employed to mitigate the impact of noise and high-dimensional nonlinearity on identification results. Finally, the processed vector curves are input into the attention module layer, where features of each layer are extracted in an encoding-decoding manner. This method has been tested and validated using gas logging data from 12 wells in a gas field offshore China. The overall prediction accuracy can exceed 94%, and the prediction accuracy for a single gas layer is over 88%. When compared to other machine learning approaches, such as K-means, decision tree, and XGBoost, this method exhibits superior identification accuracy and generalization ability, especially for unbalanced samples.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Combining Multi-Head Attention and Sparse Multi-Head Attention Networks for Session-Based Recommendation
    Zhao, Zhiwei
    Wang, Xiaoye
    Xiao, Yingyuan
    [J]. 2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [2] A Specific Emitter Identification Approach Based on Multi-Head Attention Mechanism
    Bo, Yulian
    Zhang, Wensheng
    Yang, Tongtong
    Jiang, Mingyan
    Sun, Jian
    Wang, Cheng-Xiang
    [J]. 2023 INTERNATIONAL WIRELESS COMMUNICATIONS AND MOBILE COMPUTING, IWCMC, 2023, : 953 - 958
  • [3] A Non-Intrusive Load Identification Method Based on Multi-Head Attention
    Yuan, Jie
    Jin, Ran
    Wang, Lidong
    [J]. IEEE ACCESS, 2024, 12 : 24544 - 24553
  • [4] On the diversity of multi-head attention
    Li, Jian
    Wang, Xing
    Tu, Zhaopeng
    Lyu, Michael R.
    [J]. NEUROCOMPUTING, 2021, 454 : 14 - 24
  • [5] Multi-Head Attention with Disagreement Regularization
    Li, Jian
    Tu, Zhaopeng
    Yang, Baosong
    Lyu, Michael R.
    Zhang, Tong
    [J]. 2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 2897 - 2903
  • [6] Multi-Head Attention based Probabilistic Vehicle Trajectory Prediction
    Kim, Hayoung
    Kim, Dongchan
    Kim, Gihoon
    Cho, Jeongmin
    Huh, Kunsoo
    [J]. 2020 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2020, : 1720 - 1725
  • [7] Personalized federated learning based on multi-head attention algorithm
    Jiang, Shanshan
    Lu, Meixia
    Hu, Kai
    Wu, Jiasheng
    Li, Yaogen
    Weng, Liguo
    Xia, Min
    Lin, Haifeng
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (11) : 3783 - 3798
  • [8] Multi-Head Attention-Based Spectrum Sensing for Radio
    Devarakonda, B. V. Ravisankar
    Nandanavam, Venkateswararao
    [J]. INTERNATIONAL JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING SYSTEMS, 2023, 14 (02) : 135 - 143
  • [9] A fiber recognition framework based on multi-head attention mechanism
    Xu, Luoli
    Li, Fenying
    Chang, Shan
    [J]. TEXTILE RESEARCH JOURNAL, 2024, : 2629 - 2640
  • [10] Predicting disease genes based on multi-head attention fusion
    Linlin Zhang
    Dianrong Lu
    Xuehua Bi
    Kai Zhao
    Guanglei Yu
    Na Quan
    [J]. BMC Bioinformatics, 24