Geological information prediction for shield machine using an enhanced multi-head self-attention convolution neural network with two-stage feature extraction

被引:41
|
作者
Qin, Chengjin [1 ]
Huang, Guoqiang [1 ]
Yu, Honggan [1 ]
Wu, Ruihong [1 ]
Tao, Jianfeng [1 ]
Liu, Chengliang [1 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Mech Engn, State Key Lab Mech Syst & Vibrat, Shanghai 200240, Peoples R China
基金
国家重点研发计划;
关键词
Geological information prediction; Shield machine; Enhanced multi-head self-attention; CNN; TUNNEL FACE;
D O I
10.1016/j.gsf.2022.101519
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
Due to the closed working environment of shield machines, the construction personnel cannot observe the construction geological environment, which seriously restricts the safety and efficiency of the tunnel-ing process. In this study, we present an enhanced multi-head self-attention convolution neural network (EMSACNN) with two-stage feature extraction for geological condition prediction of shield machine. Firstly, we select 30 important parameters according to statistical analysis method and the working prin-ciple of the shield machine. Then, we delete the non-working sample data, and combine 10 consecutive data as the input of the model. Thereafter, to deeply mine and extract essential and relevant features, we build a novel model combined with the particularity of the geological type recognition task, in which an enhanced multi-head self-attention block is utilized as the first feature extractor to fully extract the cor-relation of geological information of adjacent working face of tunnel, and two-dimensional CNN (2dCNN) is utilized as the second feature extractor. The performance and superiority of proposed EMSACNN are verified by the actual data collected by the shield machine used in the construction of a double-track tun-nel in Guangzhou, China. The results show that EMSACNN achieves at least 96% accuracy on the test sets of the two tunnels, and all the evaluation indicators of EMSACNN are much better than those of classical AI model and the model that use only the second-stage feature extractor. Therefore, the proposed EMSACNN achieves high accuracy and strong generalization for geological information prediction of shield machine, which is of great guiding significance to engineering practice.(c) 2022 China University of Geosciences (Beijing) and Peking University. Production and hosting by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/ licenses/by-nc-nd/4.0/).
引用
收藏
页数:19
相关论文
共 50 条
  • [21] Using Recurrent Neural Network Structure and Multi-Head Attention with Convolution for Fraudulent Phone Text Recognition
    Zhou J.
    Xu H.
    Zhang Z.
    Lu J.
    Guo W.
    Li Z.
    Computer Systems Science and Engineering, 2023, 46 (02): : 2277 - 2297
  • [22] Remaining Useful Life Prediction for Aero-Engines Using a Time-Enhanced Multi-Head Self-Attention Model
    Wang, Xin
    Li, Yi
    Xu, Yaxi
    Liu, Xiaodong
    Zheng, Tao
    Zheng, Bo
    AEROSPACE, 2023, 10 (01)
  • [23] Remaining Useful Life Prediction of Bearings Based on Multi-head Self-attention Mechanism, Multi-scale Temporal Convolutional Network and Convolutional Neural Network
    Wei, Hao
    Gu, Yu
    Zhang, Qinghua
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 3027 - 3032
  • [24] Forecasting carbon price in Hubei Province using a mixed neural model based on mutual information and Multi-head Self-Attention
    Ren, Youyang
    Huang, Yiyuan
    Wang, Yuhong
    Xia, Lin
    Wu, Dongdong
    JOURNAL OF CLEANER PRODUCTION, 2025, 494
  • [25] Machine remaining life prediction based on multi-layer self-attention and temporal convolution network
    Shang, Zhiwu
    Zhang, Baoren
    Li, Wanxiang
    Qian, Shiqi
    Zhang, Jie
    COMPLEX & INTELLIGENT SYSTEMS, 2022, 8 (02) : 1409 - 1424
  • [26] Machine remaining life prediction based on multi-layer self-attention and temporal convolution network
    Zhiwu Shang
    Baoren Zhang
    Wanxiang Li
    Shiqi Qian
    Jie Zhang
    Complex & Intelligent Systems, 2022, 8 : 1409 - 1424
  • [27] Joint extraction of entities and relations based on character graph convolutional network and Multi-Head Self-Attention Mechanism
    Meng, Zhao
    Tian, Shengwei
    Yu, Long
    Lv, Yalong
    JOURNAL OF EXPERIMENTAL & THEORETICAL ARTIFICIAL INTELLIGENCE, 2021, 33 (02) : 349 - 362
  • [28] A novel intelligent fault diagnosis method of bearing based on multi-head self-attention convolutional neural network
    Ren, Hang
    Liu, Shaogang
    Qiu, Bo
    Guo, Hong
    Zhao, Dan
    AI EDAM-ARTIFICIAL INTELLIGENCE FOR ENGINEERING DESIGN ANALYSIS AND MANUFACTURING, 2024, 38
  • [29] CPMA: Spatio-Temporal Network Prediction Model Based on Convolutional Parallel Multi-head Self-attention
    Liu, Tiantian
    You, Xin
    Ma, Ming
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT II, ICIC 2024, 2024, 14876 : 113 - 124
  • [30] Feature-Level Fusion Network for Hyperspectral Object Tracking via Mixed Multi-Head Self-Attention Learning
    Gao, Long
    Chen, Langkun
    Jiang, Yan
    Xi, Bobo
    Xie, Weiying
    Li, Yunsong
    REMOTE SENSING, 2025, 17 (06)