Geological information prediction for shield machine using an enhanced multi-head self-attention convolution neural network with two-stage feature extraction

被引:41
|
作者
Qin, Chengjin [1 ]
Huang, Guoqiang [1 ]
Yu, Honggan [1 ]
Wu, Ruihong [1 ]
Tao, Jianfeng [1 ]
Liu, Chengliang [1 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Mech Engn, State Key Lab Mech Syst & Vibrat, Shanghai 200240, Peoples R China
基金
国家重点研发计划;
关键词
Geological information prediction; Shield machine; Enhanced multi-head self-attention; CNN; TUNNEL FACE;
D O I
10.1016/j.gsf.2022.101519
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
Due to the closed working environment of shield machines, the construction personnel cannot observe the construction geological environment, which seriously restricts the safety and efficiency of the tunnel-ing process. In this study, we present an enhanced multi-head self-attention convolution neural network (EMSACNN) with two-stage feature extraction for geological condition prediction of shield machine. Firstly, we select 30 important parameters according to statistical analysis method and the working prin-ciple of the shield machine. Then, we delete the non-working sample data, and combine 10 consecutive data as the input of the model. Thereafter, to deeply mine and extract essential and relevant features, we build a novel model combined with the particularity of the geological type recognition task, in which an enhanced multi-head self-attention block is utilized as the first feature extractor to fully extract the cor-relation of geological information of adjacent working face of tunnel, and two-dimensional CNN (2dCNN) is utilized as the second feature extractor. The performance and superiority of proposed EMSACNN are verified by the actual data collected by the shield machine used in the construction of a double-track tun-nel in Guangzhou, China. The results show that EMSACNN achieves at least 96% accuracy on the test sets of the two tunnels, and all the evaluation indicators of EMSACNN are much better than those of classical AI model and the model that use only the second-stage feature extractor. Therefore, the proposed EMSACNN achieves high accuracy and strong generalization for geological information prediction of shield machine, which is of great guiding significance to engineering practice.(c) 2022 China University of Geosciences (Beijing) and Peking University. Production and hosting by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/ licenses/by-nc-nd/4.0/).
引用
收藏
页数:19
相关论文
共 50 条
  • [31] CRAT-Pred: Vehicle Trajectory Prediction with Crystal Graph Convolutional Neural Networks and Multi-Head Self-Attention
    Schmidt, Julian
    Jordan, Julian
    Gritschneder, Franz
    Dietmayer, Klaus
    2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA 2022, 2022, : 7799 - 7805
  • [32] Detection for domain generation algorithm (DGA) domain botnet based on neural network with multi-head self-attention mechanisms
    Sarojini, S.
    Asha, S.
    INTERNATIONAL JOURNAL OF SYSTEM ASSURANCE ENGINEERING AND MANAGEMENT, 2022,
  • [33] CNN-MHSA: A Convolutional Neural Network and multi-head self-attention combined approach for detecting phishing websites
    Xiao, Xi
    Zhang, Dianyan
    Hu, Guangwu
    Jiang, Yong
    Xia, Shutao
    NEURAL NETWORKS, 2020, 125 : 303 - 312
  • [34] Fusion k-means clustering and multi-head self-attention mechanism for a multivariate time prediction model with feature selection
    Cai, Mingwei
    Zhan, Jianming
    Zhang, Chao
    Liu, Qi
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024,
  • [35] MSSTGCN: Multi-Head Self-Attention and Spatial-Temporal Graph Convolutional Network for Multi-Scale Traffic Flow Prediction
    Zong, Xinlu
    Yu, Fan
    Chen, Zhen
    Xia, Xue
    CMC-COMPUTERS MATERIALS & CONTINUA, 2025, 82 (02): : 3517 - 3537
  • [36] A two-stage convolution network algorithm for predicting traffic speed based on multi-feature attention mechanisms
    Wang, Chia-Hung
    Cai, Jiongbiao
    Ye, Qing
    Suo, Yifan
    Lin, Shengming
    Yuan, Jinchen
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 45 (03) : 5181 - 5196
  • [37] Prediction of Lithium Battery Voltage and State of Charge Using Multi-Head Attention BiLSTM Neural Network
    Xi, Haiwen
    Lv, Taolin
    Qin, Jincheng
    Ma, Mingsheng
    Xie, Jingying
    Lu, Shigang
    Liu, Zhifu
    APPLIED SCIENCES-BASEL, 2025, 15 (06):
  • [38] Transformative Approach for Heart Rate Prediction from Face Videos Using Local and Global Multi-Head Self-Attention
    Premkumar, Smera
    Anitha, J.
    Danciulescu, Daniela
    Hemanth, D. Jude
    TECHNOLOGIES, 2024, 12 (01)
  • [39] ATM-TCR: TCR-Epitope Binding Affinity Prediction Using a Multi-Head Self-Attention Model
    Cai, Michael
    Bang, Seojin
    Zhang, Pengfei
    Lee, Heewook
    FRONTIERS IN IMMUNOLOGY, 2022, 13
  • [40] Remaining useful life prediction for bearing based on automatic feature combination extraction and residual multi-Head attention GRU network
    He, Jiawen
    Zhang, Xu
    Zhang, Xuechang
    Shen, Jie
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2024, 35 (03)