Geological information prediction for shield machine using an enhanced multi-head self-attention convolution neural network with two-stage feature extraction

被引:41
|
作者
Qin, Chengjin [1 ]
Huang, Guoqiang [1 ]
Yu, Honggan [1 ]
Wu, Ruihong [1 ]
Tao, Jianfeng [1 ]
Liu, Chengliang [1 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Mech Engn, State Key Lab Mech Syst & Vibrat, Shanghai 200240, Peoples R China
基金
国家重点研发计划;
关键词
Geological information prediction; Shield machine; Enhanced multi-head self-attention; CNN; TUNNEL FACE;
D O I
10.1016/j.gsf.2022.101519
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
Due to the closed working environment of shield machines, the construction personnel cannot observe the construction geological environment, which seriously restricts the safety and efficiency of the tunnel-ing process. In this study, we present an enhanced multi-head self-attention convolution neural network (EMSACNN) with two-stage feature extraction for geological condition prediction of shield machine. Firstly, we select 30 important parameters according to statistical analysis method and the working prin-ciple of the shield machine. Then, we delete the non-working sample data, and combine 10 consecutive data as the input of the model. Thereafter, to deeply mine and extract essential and relevant features, we build a novel model combined with the particularity of the geological type recognition task, in which an enhanced multi-head self-attention block is utilized as the first feature extractor to fully extract the cor-relation of geological information of adjacent working face of tunnel, and two-dimensional CNN (2dCNN) is utilized as the second feature extractor. The performance and superiority of proposed EMSACNN are verified by the actual data collected by the shield machine used in the construction of a double-track tun-nel in Guangzhou, China. The results show that EMSACNN achieves at least 96% accuracy on the test sets of the two tunnels, and all the evaluation indicators of EMSACNN are much better than those of classical AI model and the model that use only the second-stage feature extractor. Therefore, the proposed EMSACNN achieves high accuracy and strong generalization for geological information prediction of shield machine, which is of great guiding significance to engineering practice.(c) 2022 China University of Geosciences (Beijing) and Peking University. Production and hosting by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/ licenses/by-nc-nd/4.0/).
引用
收藏
页数:19
相关论文
共 50 条
  • [41] Optimized multi-head self-attention and gated-dilated convolutional neural network for quantum key distribution and error rate reduction
    Kavitha, R. Jothi
    Ilakkiaselvan, Dhandapani
    NETWORK-COMPUTATION IN NEURAL SYSTEMS, 2024, 35 (04) : 379 - 402
  • [42] DeepCAC: a deep learning approach on DNA transcription factors classification based on multi-head self-attention and concatenate convolutional neural network
    Jidong Zhang
    Bo Liu
    Jiahui Wu
    Zhihan Wang
    Jianqiang Li
    BMC Bioinformatics, 24
  • [43] DeepCAC: a deep learning approach on DNA transcription factors classification based on multi-head self-attention and concatenate convolutional neural network
    Zhang, Jidong
    Liu, Bo
    Wu, Jiahui
    Wang, Zhihan
    Li, Jianqiang
    BMC BIOINFORMATICS, 2023, 24 (01)
  • [44] Named Entity Recognition Using EHealth-BiLSTM-CRF Combine with Multi-head Self-attention for Chinese Medical Information
    Wang, Bin
    Jiang, Fangjiao
    WEB INFORMATION SYSTEMS AND APPLICATIONS, WISA 2024, 2024, 14883 : 451 - 462
  • [45] GCN-MHSA: A novel malicious traffic detection method based on graph convolutional neural network and multi-head self-attention mechanism
    Chen, Jinfu
    Xie, Haodi
    Cai, Saihua
    Song, Luo
    Geng, Bo
    Guo, Wuhao
    COMPUTERS & SECURITY, 2024, 147
  • [46] Multi-scale network traffic prediction using a two-stage neural network combined model
    Feng Hai-liang
    Chen Di
    Lin Qing-jia
    Chen Chun-xiao
    2006 IEEE INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, NETWORKING AND MOBILE COMPUTING, VOLS 1-4, 2006, : 1529 - 1533
  • [47] DBC-MulBiLSTM: A DistilBERT-CNN Feature Fusion Framework enhanced by multi-head self-attention and BiLSTM for smart contract vulnerability detection
    Xu, Shujiang
    He, Haochen
    Mihaljevic, Miodrag J.
    Zhang, Shuhui
    Shao, Wei
    Wang, Qizheng
    COMPUTERS & ELECTRICAL ENGINEERING, 2025, 123
  • [48] Tumor detection in breast cancer pathology patches using a Multi-scale Multi-head Self-attention Ensemble Network on Whole Slide Images
    Ge, Ruigang
    Chen, Guoyue
    Saruta, Kazuki
    Terata, Yuki
    MACHINE LEARNING WITH APPLICATIONS, 2024, 18
  • [49] Multi-Head Self-Attention-Enhanced Prototype Network with Contrastive-Center Loss for Few-Shot Relation Extraction
    Ma, Jiangtao
    Cheng, Jia
    Chen, Yonggang
    Li, Kunlin
    Zhang, Fan
    Shang, Zhanlei
    APPLIED SCIENCES-BASEL, 2024, 14 (01):
  • [50] WSAFormer-DFFN: A model for rotating machinery fault diagnosis using 1D window-based multi-head self-attention and deep feature fusion network
    Wei, Qingzhe
    Tian, Xincheng
    Cui, Long
    Zheng, Fuquan
    Liu, Lida
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 124