Autonomous Defense of Unmanned Aerial Vehicles Against Missile Attacks Using a GRU-Based PPO Algorithm

被引:3
|
作者
Zhang, Cheng [1 ]
Tao, Chengyang [1 ]
Xu, Yuelei [1 ]
Feng, Weijia [1 ]
Rasol, Jarhinbek [1 ]
Hui, Tian [1 ]
Dong, Liheng [1 ]
机构
[1] Northwestern Polytech Univ, Unmanned Syst Res Inst, 127 West Youyi Rd, Xian 710072, Shaanxi, Peoples R China
关键词
Unmanned aerial vehicle; Deep reinforcement learning; Decision-making; Centroid jamming; EVASIVE MANEUVER STRATEGY; REINFORCEMENT; DECISION;
D O I
10.1007/s42405-024-00707-7
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
This paper introduces a method enabling unmanned aerial vehicles (UAVs) to autonomously defend themselves against incoming missiles during military missions. A simulation environment for UAV defense against incoming missiles was created by constructing motion models for a UAV, a missile, and infrared decoys in three-dimensional space. A UAV defense strategy generation algorithm based on gated recurrent unit (GRU) and proximal policy optimization (PPO) is proposed, which effectively addresses the problem of low survival rates when under attack from enemy missiles. Specifically, the algorithm estimates the current true state based on current and historical observations and makes decisions based on the state estimate, effectively solving the non-Markov problem caused by the lack of infrared decoy information in the observations. The experimental results indicate that this method provides an effective defense strategy, combining evasion maneuvers with infrared decoys to effectively evade incoming missiles.
引用
收藏
页码:1034 / 1049
页数:16
相关论文
共 50 条
  • [31] Adversarial Attacks and Defenses for Deep-Learning-Based Unmanned Aerial Vehicles
    Tian, Jiwei
    Wang, Buhong
    Guo, Rongxiao
    Wang, Zhen
    Cao, Kunrui
    Wang, Xiaodong
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (22): : 22399 - 22409
  • [32] Autonomous Obstacle Avoidance and Navigation Method For Unmanned Aerial Vehicles Based on Multi-Sensor Fusion Algorithm
    Jin, Min
    Tao, Jun
    Qiu, Zhen
    Bai, Jingpo
    Liang, Chong
    Li, Xiaoning
    2024 3RD INTERNATIONAL CONFERENCE ON ENERGY AND ELECTRICAL POWER SYSTEMS, ICEEPS 2024, 2024, : 1329 - 1335
  • [33] Design of Controllers Applied to Autonomous Unmanned Aerial Vehicles Using Software In The Loop
    Silva, D. H. C.
    Santos, M. F.
    Silva, M. F.
    Neto, A. F. S.
    Mercorelli, P.
    2019 20TH INTERNATIONAL CARPATHIAN CONTROL CONFERENCE (ICCC), 2019, : 714 - 719
  • [34] Autonomous Target Search Using Unmanned Aerial Vehicles in the Presence of Signal Noise
    Pietz, Jesse
    Wilck, Joseph H.
    Christensen, Soren
    Melville, Mitchell
    Stank, J. Quinn
    Zaiser, Sarah
    IEEE COMMUNICATIONS LETTERS, 2022, 26 (09) : 2141 - 2145
  • [35] Autonomous Person Detection and Tracking Framework Using Unmanned Aerial Vehicles (UAVs)
    Fradi, Hajer
    Bracco, Lorenzo
    Canino, Flavia
    Dugelay, Jean-Luc
    2018 26TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2018, : 1047 - 1051
  • [36] Autonomous Unmanned Aerial Vehicles Based Decision Support System for Weed Management
    Dutta, Ashit Kumar
    Albagory, Yasser
    Sait, Abdul Rahaman Wahab
    Keshta, Ismail Mohamed
    CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 73 (01): : 899 - 915
  • [37] An Autonomous Tracking and Landing Method for Unmanned Aerial Vehicles Based on Visual Navigation
    Wang, Bingkun
    Ma, Ruitao
    Zhu, Hang
    Sha, Yongbai
    Yang, Tianye
    DRONES, 2023, 7 (12)
  • [38] Optimal scheduling for aerial recovery of multiple unmanned aerial vehicles using genetic algorithm
    Liu, Yongbei
    Qi, Naiming
    Yao, Weiran
    Liu, Yanfang
    Li, Yuan
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART G-JOURNAL OF AEROSPACE ENGINEERING, 2019, 233 (14) : 5347 - 5359
  • [39] A vision-based system for autonomous vertical landing of unmanned aerial vehicles
    Wubben, Jamie
    Fabra, Francisco
    Calafate, Carlos T.
    Krzeszowski, Tomasz
    Marquez-Barja, Johann M.
    Cano, Juan-Carlos
    Manzoni, Pietro
    2019 IEEE/ACM 23RD INTERNATIONAL SYMPOSIUM ON DISTRIBUTED SIMULATION AND REAL TIME APPLICATIONS (DS-RT), 2019, : 188 - 194
  • [40] A Configurable Radio Jamming Prototype for Physical Layer Attacks Against Malicious Unmanned Aerial Vehicles
    Caforio, Giulio
    Scazzoli, Davide
    Reggiani, Luca
    Magarini, Maurizio
    Le Moullec, Yannick
    Alam, Muhammad Mahtab
    2020 17TH BIENNIAL BALTIC ELECTRONICS CONFERENCE (BEC), 2020,