Enhanced Radar Anti-Jamming With Multi-Agent Reinforcement Learning

被引:0
|
作者
Peng, Wenshen [1 ]
He, Chuan [1 ]
Cao, Fei [1 ]
Hu, Changhua [1 ]
Jiao, Licheng [2 ]
机构
[1] Rocket Force Univ Engn, Xian 710025, Peoples R China
[2] Xidian Univ, Sch Artificial Intelligence, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Jamming; Radar; Games; Decision making; Electronic countermeasures; Convergence; Spaceborne radar; Radar countermeasures; Indexes; Signal processing algorithms; Multi-agent deep reinforcement learning (MADRL); neural fictitious self-play (NFSP); radar anti-jamming; extensive-form game (EFG); decision making; GAME-THEORY;
D O I
10.1109/LSP.2024.3493797
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As jamming systems continue to evolve, jammers are becoming increasingly complex. They modify their strategies in response to changes in radar status, thereby creating a dynamic confrontation with the radar. Currently, deep reinforcement learning (DRL) methods are widely employed in the decision-making process for radar anti-jamming strategies; however, most of these methods overlook the learning capabilities of the jammer. This letter proposes a novel multi-agent deep reinforcement learning (MADRL) method that leverages the robust capabilities of the neural fictitious self-play (NFSP) method and extensive-form game (EFG) frameworks to address multi-agent interactions and partial information observability challenges. The letter primarily discusses the model design, which includes the construction of the EFG framework, hierarchical optimization of the action space, and the design of the reward function. Comparative results with other state-of-the-art methods demonstrate that this approach achieves significant accuracy and rapid convergence in anti-jamming decision-making, thereby effectively enhancing the intelligent anti-jamming capabilities of radar systems.
引用
收藏
页码:3114 / 3118
页数:5
相关论文
共 50 条
  • [21] Reinforcement Learning based Anti-jamming Frequency Hopping Strategies Design for Cognitive Radar
    Li Kang
    Jiu Bo
    Liu Hongwei
    Liang Siyuan
    2018 IEEE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, COMMUNICATIONS AND COMPUTING (ICSPCC), 2018,
  • [22] Deep Reinforcement Learning Based Multi-User Anti-Jamming Strategy
    Bi, Yue
    Wu, Yue
    Hua, Cunqing
    IEEE International Conference on Communications, 2019, 2019-May
  • [23] An Anti-jamming Game in VANET Platoon with Reinforcement Learning
    Fan, Yexian
    Xiao, Xingyu
    Feng, Wei
    2018 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS-TAIWAN (ICCE-TW), 2018,
  • [24] Radar Waveform Design Based on Multi-Agent Reinforcement Learning
    Yang, Qingpei
    Han, Zhuangzhi
    Wang, Han
    Dong, Jian
    Zhao, Yang
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2021, 35 (10)
  • [25] Anti-Jamming Strategy Based on Reinforcement Learning with Sequence Information
    Shin, Yoan (yashin@ssu.ac.kr), 1600, Institute of Electrical and Electronics Engineers Inc.
  • [26] Intelligent Anti-Jamming Based on Deep Reinforcement Learning and Transfer Learning
    Janiar, Siavash Barqi
    Wang, Ping
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (06) : 8825 - 8834
  • [27] Intelligent Anti-jamming Decision Algorithm for Frequency Hopping Network Based on Multi-agent Fuzzy Deep Reinforcemnet Learning
    Zhao Zhijin
    Zhu Jiasheng
    Ye Xueyi
    Shang Junna
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2022, 44 (08) : 2814 - 2823
  • [28] Anti-Jamming Communications in UAV Swarms: A Reinforcement Learning Approach
    Peng, Jinlin
    Zhang, Zixuan
    Wu, Qinhao
    Zhang, Bo
    IEEE ACCESS, 2019, 7 : 180532 - 180543
  • [29] A hidden anti-jamming method based on deep reinforcement learning
    Wang, Yifan
    Liu, Xin
    Wang, Mei
    Yu, Yu
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2021, 15 (09): : 3444 - 3457
  • [30] (T, ε)-GREEDY REINFORCEMENT LEARNING FOR ANTI-JAMMING WIRELESS COMMUNICATIONS
    Ye, Pei-Gen
    Wang, Yuan-Gen
    Li, Jin
    Xiao, Liang
    Zhu, Guopu
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,