Geological information prediction for shield machine using an enhanced multi-head self-attention convolution neural network with two-stage feature extraction

被引:41
|
作者
Qin, Chengjin [1 ]
Huang, Guoqiang [1 ]
Yu, Honggan [1 ]
Wu, Ruihong [1 ]
Tao, Jianfeng [1 ]
Liu, Chengliang [1 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Mech Engn, State Key Lab Mech Syst & Vibrat, Shanghai 200240, Peoples R China
基金
国家重点研发计划;
关键词
Geological information prediction; Shield machine; Enhanced multi-head self-attention; CNN; TUNNEL FACE;
D O I
10.1016/j.gsf.2022.101519
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
Due to the closed working environment of shield machines, the construction personnel cannot observe the construction geological environment, which seriously restricts the safety and efficiency of the tunnel-ing process. In this study, we present an enhanced multi-head self-attention convolution neural network (EMSACNN) with two-stage feature extraction for geological condition prediction of shield machine. Firstly, we select 30 important parameters according to statistical analysis method and the working prin-ciple of the shield machine. Then, we delete the non-working sample data, and combine 10 consecutive data as the input of the model. Thereafter, to deeply mine and extract essential and relevant features, we build a novel model combined with the particularity of the geological type recognition task, in which an enhanced multi-head self-attention block is utilized as the first feature extractor to fully extract the cor-relation of geological information of adjacent working face of tunnel, and two-dimensional CNN (2dCNN) is utilized as the second feature extractor. The performance and superiority of proposed EMSACNN are verified by the actual data collected by the shield machine used in the construction of a double-track tun-nel in Guangzhou, China. The results show that EMSACNN achieves at least 96% accuracy on the test sets of the two tunnels, and all the evaluation indicators of EMSACNN are much better than those of classical AI model and the model that use only the second-stage feature extractor. Therefore, the proposed EMSACNN achieves high accuracy and strong generalization for geological information prediction of shield machine, which is of great guiding significance to engineering practice.(c) 2022 China University of Geosciences (Beijing) and Peking University. Production and hosting by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/ licenses/by-nc-nd/4.0/).
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Using recurrent neural network structure with Enhanced Multi-Head Self-Attention for sentiment analysis
    Xue-Liang Leng
    Xiao-Ai Miao
    Tao Liu
    Multimedia Tools and Applications, 2021, 80 : 12581 - 12600
  • [2] Using recurrent neural network structure with Enhanced Multi-Head Self-Attention for sentiment analysis
    Leng, Xue-Liang
    Miao, Xiao-Ai
    Liu, Tao
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (08) : 12581 - 12600
  • [3] Multi-head enhanced self-attention network for novelty detection
    Zhang, Yingying
    Gong, Yuxin
    Zhu, Haogang
    Bai, Xiao
    Tang, Wenzhong
    PATTERN RECOGNITION, 2020, 107
  • [4] MSnet: Multi-Head Self-Attention Network for Distantly Supervised Relation Extraction
    Sun, Tingting
    Zhang, Chunhong
    Ji, Yang
    Hu, Zheng
    IEEE ACCESS, 2019, 7 : 54472 - 54482
  • [5] Prediction of shield tunneling-induced ground settlement using LSTM architecture enhanced by multi-head self-attention mechanism
    Yang, Minghui
    Song, Muyuan
    Guo, Yanwei
    Lyv, Zhuoyang
    Chen, Wei
    Yao, Gaozhan
    TUNNELLING AND UNDERGROUND SPACE TECHNOLOGY, 2025, 161
  • [6] Drug-Target Interaction Prediction Using Multi-Head Self-Attention and Graph Attention Network
    Cheng, Zhongjian
    Yan, Cheng
    Wu, Fang-Xiang
    Wang, Jianxin
    IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, 2022, 19 (04) : 2208 - 2218
  • [7] Research on Enhanced Multi-head Self-Attention Social Recommendation Algorithm Based on Graph Neural Network
    Teng, Yue
    Yang, Kai
    IAENG International Journal of Computer Science, 2024, 51 (07) : 754 - 764
  • [8] DeepMHADTA: Prediction of Drug-Target Binding Affinity Using Multi-Head Self-Attention and Convolutional Neural Network
    Deng, Lei
    Zeng, Yunyun
    Liu, Hui
    Liu, Zixuan
    Liu, Xuejun
    CURRENT ISSUES IN MOLECULAR BIOLOGY, 2022, 44 (05) : 2287 - 2299
  • [9] SA-GNN: Prediction of material properties using graph neural network based on multi-head self-attention optimization
    Cui, Yasen
    Zhu, Jian
    Zhou, Wei
    Zang, Huaijuan
    Ren, Yongsheng
    Xu, Jiajia
    Zhan, Shu
    Ma, Wenhui
    AIP ADVANCES, 2024, 14 (05)
  • [10] A Model for Sea Ice Segmentation based on Feature Pyramid Network and Multi-head Self-attention
    Xu, Yuanxiang
    Feng, Yuan
    Song, Shengyu
    Liu, Jiahao
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 97 - 102