Enhanced Radar Anti-Jamming With Multi-Agent Reinforcement Learning

被引:0
|
作者
Peng, Wenshen [1 ]
He, Chuan [1 ]
Cao, Fei [1 ]
Hu, Changhua [1 ]
Jiao, Licheng [2 ]
机构
[1] Rocket Force Univ Engn, Xian 710025, Peoples R China
[2] Xidian Univ, Sch Artificial Intelligence, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Jamming; Radar; Games; Decision making; Electronic countermeasures; Convergence; Spaceborne radar; Radar countermeasures; Indexes; Signal processing algorithms; Multi-agent deep reinforcement learning (MADRL); neural fictitious self-play (NFSP); radar anti-jamming; extensive-form game (EFG); decision making; GAME-THEORY;
D O I
10.1109/LSP.2024.3493797
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As jamming systems continue to evolve, jammers are becoming increasingly complex. They modify their strategies in response to changes in radar status, thereby creating a dynamic confrontation with the radar. Currently, deep reinforcement learning (DRL) methods are widely employed in the decision-making process for radar anti-jamming strategies; however, most of these methods overlook the learning capabilities of the jammer. This letter proposes a novel multi-agent deep reinforcement learning (MADRL) method that leverages the robust capabilities of the neural fictitious self-play (NFSP) method and extensive-form game (EFG) frameworks to address multi-agent interactions and partial information observability challenges. The letter primarily discusses the model design, which includes the construction of the EFG framework, hierarchical optimization of the action space, and the design of the reward function. Comparative results with other state-of-the-art methods demonstrate that this approach achieves significant accuracy and rapid convergence in anti-jamming decision-making, thereby effectively enhancing the intelligent anti-jamming capabilities of radar systems.
引用
收藏
页码:3114 / 3118
页数:5
相关论文
共 50 条
  • [41] Multi-domain united anti-jamming algorithm for monopulse radar
    Li, Naihao
    Wang, Runnan
    Tang, Yu
    Proceedings of SPIE - The International Society for Optical Engineering, 13442
  • [42] A New Anti-jamming Strategy Based on Deep Reinforcement Learning for MANET
    Xu, Yingying
    Lei, Ming
    Li, Min
    Zhao, Minjian
    Hu, Bing
    2019 IEEE 89TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2019-SPRING), 2019,
  • [43] Reinforcement Learning Based Anti-jamming with Wideband Autonomous Cognitive Radios
    Machuzak, Stephen
    Jayaweera, Sudharman K.
    2016 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA (ICCC), 2016,
  • [44] A Reinforcement Learning Approach for Dynamic Spectrum Anti-jamming in Fading Environment
    Kong, Lijun
    Xu, Yuhua
    Zhang, Yuli
    Pei, Xufang
    Ke, Mingxing
    Wang, Ximing
    Bai, Wei
    Feng, Zhibin
    2018 IEEE 18TH INTERNATIONAL CONFERENCE ON COMMUNICATION TECHNOLOGY (ICCT), 2018, : 51 - 58
  • [45] Towards reinforcement learning in UAV relay for anti-jamming maritime communications
    Chuhuan Liu
    Yi Zhang
    Guohang Niu
    Luliang Jia
    Liang Xiao
    Jiangxia Luan
    Digital Communications and Networks, 2023, 9 (06) : 1477 - 1485
  • [46] Intelligent Anti-Jamming Relay Communication System Based on Reinforcement Learning
    Zhang, Zixuan
    Wu, Qinhao
    Zhang, Bo
    Peng, Jinlin
    PROCEEDINGS OF 2019 2ND INTERNATIONAL CONFERENCE ON COMMUNICATION ENGINEERING AND TECHNOLOGY (ICCET 2019), 2019, : 52 - 56
  • [47] Deep multi-agent RL for anti-jamming and inter-cell interference mitigation in NOMA networks
    Marandi, Sina Yousefzadeh
    Amirabadi, Mohammad Ali
    Kahaei, Mohammad Hossein
    Razavizadeh, S. Mohammad
    IET COMMUNICATIONS, 2025, 19 (01)
  • [48] A cooperative jamming decision-making method based on multi-agent reinforcement learning
    Bingchen Cai
    Haoran Li
    Naimin Zhang
    Mingyu Cao
    Han Yu
    Autonomous Intelligent Systems, 5 (1):
  • [49] Towards reinforcement learning in UAV relay for anti-jamming maritime communications
    Liu, Chuhuan
    Zhang, Yi
    Niu, Guohang
    Jia, Luliang
    Xiao, Liang
    Luan, Jiangxia
    DIGITAL COMMUNICATIONS AND NETWORKS, 2023, 9 (06) : 1477 - 1485
  • [50] RADAR ANTI-JAMMING STRATEGY LEARNING VIA DOMAIN-KNOWLEDGE ENHANCED ONLINE CONVEX OPTIMIZATION
    Liu, Liangqi
    Pu, Wenqiang
    Li, Yingru
    Jiu, Bo
    Luo, Zhi-Quan
    2024 IEEE 13RD SENSOR ARRAY AND MULTICHANNEL SIGNAL PROCESSING WORKSHOP, SAM 2024, 2024,