Research on Microseismic Source Locations Based on Deep Reinforcement Learning

被引:14
|
作者
Wu, Yangxu [1 ]
Wei, Jiaotong [1 ]
Pan, Jinxiao [2 ]
Chen, Ping [2 ]
机构
[1] North Univ China, Shanxi Key Lab Signal Capturing & Proc, Taiyuan 030051, Shanxi, Peoples R China
[2] North Univ China, Natl Key Lab Elect Measurement Technol, Taiyuan 030051, Shanxi, Peoples R China
基金
美国国家科学基金会;
关键词
Convolutional neural network (CNN); deep reinforcement learning (DRL); deep Q-learning (DQN); source-scanning algorithm (SSA); IDENTIFICATION;
D O I
10.1109/ACCESS.2019.2906066
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The technology used to locate the sources of shallow underground seismic activity is mainly used to assess underground damage, the positioning of bombs in ordnance test fields, and the positioning of charges in engineering blasting. Due to sensor acquisition clock errors and the lack of generalizability of vibration data, the current sourced location methods cannot easily meet the requirements of precise positioning and system reaction time in assessing near-field microseismic activity. Based on the seismic wave analysis technique and the deep reinforcement learning method, this paper proposes a dynamic model for locating shallow underground seismic sources. The model allows the generalization of low-dimensional vibration waves information to high dimensions through spatial scanning. The process of source detection is treated as a Markov process. The correspondence between the center of a source and a high-dimensional energy distribution is established, and training is then gradually performed using the deep reinforcement learning method. The optimization of the center of the source to accurately determine the position of the focal center is provisionally called the reinforcement learning source scanning algorithm (RL-SSA). In addition, a small site-based static explosion test shows that the positioning method can greatly improve the positioning accuracy (<1 m) in the location of near-field microseismic sources.
引用
收藏
页码:39962 / 39973
页数:12
相关论文
共 50 条
  • [21] Research Reviews of Combinatorial Optimization Methods Based on Deep Reinforcement Learning
    Li, Kai-Wen
    Zhang, Tao
    Wang, Rui
    Qin, Wei-Jian
    He, Hui-Hui
    Huang, Hong
    Zidonghua Xuebao/Acta Automatica Sinica, 2021, 47 (11): : 2521 - 2537
  • [22] Research on Game-Playing Agents Based on Deep Reinforcement Learning
    Zhao, Kai
    Song, Jia
    Luo, Yuxie
    Liu, Yang
    ROBOTICS, 2022, 11 (02)
  • [23] Research on power allocation of integrated VLPC based on deep reinforcement learning
    Ma, Shuai
    Li, Bing
    Sheng, Haihong
    Gu, Rongyan
    Zhou, Hui
    Wang, Hongmei
    Wang, Yue
    Li, Shiyin
    Tongxin Xuebao/Journal on Communications, 2022, 43 (08): : 121 - 130
  • [24] Research on Deployment of Communication Node Vehicles Based on Deep Reinforcement Learning
    Yang, Ruopeng
    Zou, Xiaofei
    Nie, Zongzhe
    Yin, Changsheng
    PROCEEDINGS OF 2018 5TH IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND INTELLIGENCE SYSTEMS (CCIS), 2018, : 484 - 487
  • [25] Research on Ecological Driving Following Strategy Based on Deep Reinforcement Learning
    Zhou, Weiqi
    Wu, Nanchi
    Liu, Qingchao
    Pan, Chaofeng
    Chen, Long
    SUSTAINABILITY, 2023, 15 (18)
  • [26] Research on Cooperative Control of Traffic Signals based on Deep Reinforcement Learning
    Fan, Lingling
    Yang, Yusong
    Ji, Honghai
    Xiong, Shuangshuang
    2023 IEEE 12TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE, DDCLS, 2023, : 1608 - 1612
  • [27] A Survey of Robot Manipulation Behavior Research Based on Deep Reinforcement Learning
    Chen J.
    Zheng M.
    Jiqiren/Robot, 2022, 44 (02): : 236 - 256
  • [28] Research on Autonomous Maneuvering Decision of UCAV Based on Deep Reinforcement Learning
    Zhang, Yesheng
    Hi, Wei
    Gao, Yang
    Chang, Hongxing
    PROCEEDINGS OF THE 30TH CHINESE CONTROL AND DECISION CONFERENCE (2018 CCDC), 2018, : 230 - 235
  • [29] Research on Robot Intelligent Control Method Based on Deep Reinforcement Learning
    Rao, Shu
    2022 6TH INTERNATIONAL SYMPOSIUM ON COMPUTER SCIENCE AND INTELLIGENT CONTROL, ISCSIC, 2022, : 221 - 225
  • [30] Research on Control of Unmanned Surface Vehicle Based on Deep Reinforcement Learning
    Li, Baoan
    Ship Building of China, 2020, 61 : 14 - 20