Enhanced Radar Anti-Jamming With Multi-Agent Reinforcement Learning

被引:0
|
作者
Peng, Wenshen [1 ]
He, Chuan [1 ]
Cao, Fei [1 ]
Hu, Changhua [1 ]
Jiao, Licheng [2 ]
机构
[1] Rocket Force Univ Engn, Xian 710025, Peoples R China
[2] Xidian Univ, Sch Artificial Intelligence, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Jamming; Radar; Games; Decision making; Electronic countermeasures; Convergence; Spaceborne radar; Radar countermeasures; Indexes; Signal processing algorithms; Multi-agent deep reinforcement learning (MADRL); neural fictitious self-play (NFSP); radar anti-jamming; extensive-form game (EFG); decision making; GAME-THEORY;
D O I
10.1109/LSP.2024.3493797
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As jamming systems continue to evolve, jammers are becoming increasingly complex. They modify their strategies in response to changes in radar status, thereby creating a dynamic confrontation with the radar. Currently, deep reinforcement learning (DRL) methods are widely employed in the decision-making process for radar anti-jamming strategies; however, most of these methods overlook the learning capabilities of the jammer. This letter proposes a novel multi-agent deep reinforcement learning (MADRL) method that leverages the robust capabilities of the neural fictitious self-play (NFSP) method and extensive-form game (EFG) frameworks to address multi-agent interactions and partial information observability challenges. The letter primarily discusses the model design, which includes the construction of the EFG framework, hierarchical optimization of the action space, and the design of the reward function. Comparative results with other state-of-the-art methods demonstrate that this approach achieves significant accuracy and rapid convergence in anti-jamming decision-making, thereby effectively enhancing the intelligent anti-jamming capabilities of radar systems.
引用
收藏
页码:3114 / 3118
页数:5
相关论文
共 50 条
  • [31] Intelligent Anti-jamming based on Deep Reinforcement Learning and Transfer Learning
    Janiar, Siavash Barqi
    Wang, Ping
    IEEE Transactions on Vehicular Technology, 1600, (1-10):
  • [32] Multi-Agent Reinforcement Learning Based UAV Swarm Communications Against Jamming
    Lv, Zefang
    Xiao, Liang
    Du, Yousong
    Niu, Guohang
    Xing, Chengwen
    Xu, Wenyuan
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2023, 22 (12) : 9063 - 9075
  • [33] Cooperative Multi-Agent Jamming of Multiple Rogue Drones Using Reinforcement Learning
    Valianti, Panayiota
    Malialis, Kleanthis
    Kolios, Panayiotis
    Ellinas, Georgios
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (12) : 12345 - 12359
  • [34] A Novel Distributed Multi-Agent Reinforcement Learning Algorithm Against Jamming Attacks
    Elleuch, Ibrahim
    Pourranjbar, Ali
    Kaddoum, Georges
    IEEE COMMUNICATIONS LETTERS, 2021, 25 (10) : 3204 - 3208
  • [35] Multi-Agent Reinforcement Learning
    Stankovic, Milos
    2016 13TH SYMPOSIUM ON NEURAL NETWORKS AND APPLICATIONS (NEUREL), 2016, : 43 - 43
  • [36] An Intelligent Anti-jamming Decision-making Method Based on Deep Reinforcement Learning for Cognitive Radar
    Jiang, Wen
    Wang, Yanping
    Li, Yang
    Lin, Yun
    Shen, Wenjie
    Proceedings of the 2023 26th International Conference on Computer Supported Cooperative Work in Design, CSCWD 2023, 2023, : 1662 - 1666
  • [37] An Improved Radar Anti-jamming Method
    Hu Haitao
    Liu Ruihuang
    Zhang Jianyun
    2018 IEEE 3RD INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING (ICSIP), 2018, : 439 - 443
  • [38] Multi-agent Deep Reinforcement Learning for Dynamic Motion Control Allocation in UAV Swarm Cooperative Jamming to Netted Radar
    Li, Jiantao
    Liu, Kai
    Zhang, Tianxian
    PROCEEDINGS OF 2022 INTERNATIONAL CONFERENCE ON AUTONOMOUS UNMANNED SYSTEMS, ICAUS 2022, 2023, 1010 : 1204 - 1213
  • [39] Anti-jamming Waveform Design of Ground-based Air Surveillance Radar Based on Reinforcement Learning
    Zheng Z.
    Li W.
    Zou K.
    Li Y.
    Binggong Xuebao/Acta Armamentarii, 2023, 44 (05): : 1422 - 1430
  • [40] Multi-Agent Navigation with Reinforcement Learning Enhanced Information Seeking
    Zhang, Siwei
    Guerra, Anna
    Guidi, Francesco
    Dardari, Davide
    Djuric, Petar M.
    2022 30TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2022), 2022, : 982 - 986