Autonomous Defense of Unmanned Aerial Vehicles Against Missile Attacks Using a GRU-Based PPO Algorithm

被引:3
|
作者
Zhang, Cheng [1 ]
Tao, Chengyang [1 ]
Xu, Yuelei [1 ]
Feng, Weijia [1 ]
Rasol, Jarhinbek [1 ]
Hui, Tian [1 ]
Dong, Liheng [1 ]
机构
[1] Northwestern Polytech Univ, Unmanned Syst Res Inst, 127 West Youyi Rd, Xian 710072, Shaanxi, Peoples R China
关键词
Unmanned aerial vehicle; Deep reinforcement learning; Decision-making; Centroid jamming; EVASIVE MANEUVER STRATEGY; REINFORCEMENT; DECISION;
D O I
10.1007/s42405-024-00707-7
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
This paper introduces a method enabling unmanned aerial vehicles (UAVs) to autonomously defend themselves against incoming missiles during military missions. A simulation environment for UAV defense against incoming missiles was created by constructing motion models for a UAV, a missile, and infrared decoys in three-dimensional space. A UAV defense strategy generation algorithm based on gated recurrent unit (GRU) and proximal policy optimization (PPO) is proposed, which effectively addresses the problem of low survival rates when under attack from enemy missiles. Specifically, the algorithm estimates the current true state based on current and historical observations and makes decisions based on the state estimate, effectively solving the non-Markov problem caused by the lack of infrared decoy information in the observations. The experimental results indicate that this method provides an effective defense strategy, combining evasion maneuvers with infrared decoys to effectively evade incoming missiles.
引用
收藏
页码:1034 / 1049
页数:16
相关论文
共 50 条
  • [1] Learning-Based Defense Against Malicious Unmanned Aerial Vehicles
    Min, Minghui
    Xiao, Liang
    Xu, Dongjin
    Huang, Lianfen
    Peng, Mugen
    2018 IEEE 87TH VEHICULAR TECHNOLOGY CONFERENCE (VTC SPRING), 2018,
  • [2] An Improved Vision-Based Algorithm for Unmanned Aerial Vehicles Autonomous Landing
    Zhao, Yunji
    Pei, Hailong
    2012 INTERNATIONAL CONFERENCE ON MEDICAL PHYSICS AND BIOMEDICAL ENGINEERING (ICMPBE2012), 2012, 33 : 935 - 941
  • [3] An Improved Vision-Based Algorithm for Unmanned Aerial Vehicles Autonomous Landing
    Zhao, Yunji
    Pei, Hailong
    Wang, Shidi
    2010 INTERNATIONAL COLLOQUIUM ON COMPUTING, COMMUNICATION, CONTROL, AND MANAGEMENT (CCCM2010), VOL II, 2010, : 84 - 87
  • [4] Autonomous Obstacle Avoidance Algorithm for Unmanned Aerial Vehicles Based on Deep Reinforcement Learning
    Gao, Yuan
    Ren, Ling
    Shi, Tianwei
    Xu, Teng
    Ding, Jianbang
    ENGINEERING LETTERS, 2024, 32 (03) : 650 - 660
  • [5] Cyber Attacks on Healthcare Devices Using Unmanned Aerial Vehicles
    Sethuraman, Sibi Chakkaravarthy
    Vijayakumar, Vaidehi
    Walczak, Steven
    JOURNAL OF MEDICAL SYSTEMS, 2020, 44 (01)
  • [6] Cyber Attacks on Healthcare Devices Using Unmanned Aerial Vehicles
    Sibi Chakkaravarthy Sethuraman
    Vaidehi Vijayakumar
    Steven Walczak
    Journal of Medical Systems, 2020, 44
  • [7] Stealthy Perception-based Attacks on Unmanned Aerial Vehicles
    Khazraei, Amir
    Meng, Haocheng
    Pajic, Miroslav
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 3346 - 3352
  • [8] Autonomous Exploration of Urban Environments using Unmanned Aerial Vehicles
    Adler, Benjamin
    Xiao, Junhao
    Zhang, Jianwei
    JOURNAL OF FIELD ROBOTICS, 2014, 31 (06) : 912 - 939
  • [9] Autonomous Flight of Unmanned Aerial Vehicles Using Evolutionary Algorithms
    Gaudin, Americo
    Madruga, Gabriel
    Rodriguez, Carlos
    Iturriaga, Santiago
    Nesmachnow, Sergio
    Paz, Claudio
    Danoy, Gregoire
    Bouvry, Pascal
    HIGH PERFORMANCE COMPUTING, CARLA 2019, 2020, 1087 : 337 - 352
  • [10] Autonomous Patrol and Surveillance System using Unmanned Aerial Vehicles
    Seng, Lee Kian
    Ovinis, Mark
    Nagarajan, T.
    Seulin, Ralph
    Morel, Olivier
    2015 IEEE 15TH INTERNATIONAL CONFERENCE ON ENVIRONMENT AND ELECTRICAL ENGINEERING (IEEE EEEIC 2015), 2015, : 1291 - 1297