Deep Reinforcement Learning-Based Anti-Jamming Algorithm Using Dual Action Network

被引:3
|
作者
Li, Xiangchen [1 ]
Chen, Jienan [1 ]
Ling, Xiang [1 ]
Wu, Tingyong [1 ]
机构
[1] Univ Elect Sci & Technol China, Natl Key Lab Sci & Technol Commun, Chengdu 611731, Sichuan, Peoples R China
基金
中国国家自然科学基金;
关键词
Jamming; Wireless communication; Games; Receivers; Electromagnetics; Testing; Switches; Anti-jamming; Markov decision process; Index Terms; deep reinforcement learning; dual action network; action feedback mechanism; power efficiency; frequency switching overhead; field testing; STACKELBERG GAME; SYSTEMS;
D O I
10.1109/TWC.2022.3227575
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Due to the open nature of wireless communication, malicious electromagnetic jamming has long been a severe threat to the establishment and stability of communication links. To address this anti-jamming problem, a Markov decision process (MDP) with a two-dimensional action space consisting of transmit frequency and power is proposed in this paper, modeling the interaction between a normal communication link and the presence of malicious jammers in a frequency hopping (FH) communication system. Furthermore, we also prove the existence of the deterministic optimal policy of the proposed model theoretically. To obtain a policy for the communication link to avoid being jammed, the Dual Action Network-Based Deep Reinforcement Learning Algorithm, and Action Feedback Mechanism are proposed. The energy consumption and frequency switching overhead are considered and evaluated in both the proposed model and the algorithm. Finally, the proposed model and algorithm are verified not only in a virtual simulation environment but also in the field testing environment. The result suggests that the proposed algorithm is of great practical value for solving anti-jamming problems.
引用
收藏
页码:4625 / 4637
页数:13
相关论文
共 50 条
  • [1] On the Performance of Deep Reinforcement Learning-Based Anti-Jamming Method Confronting Intelligent Jammer
    Li, Yangyang
    Wang, Ximing
    Liu, Dianxiong
    Guo, Qiuju
    Liu, Xin
    Zhang, Jie
    Xu, Yitao
    APPLIED SCIENCES-BASEL, 2019, 9 (07):
  • [2] A hidden anti-jamming method based on deep reinforcement learning
    Wang, Yifan
    Liu, Xin
    Wang, Mei
    Yu, Yu
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2021, 15 (09): : 3444 - 3457
  • [3] Intelligent Anti-Jamming Based on Deep Reinforcement Learning and Transfer Learning
    Janiar, Siavash Barqi
    Wang, Ping
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (06) : 8825 - 8834
  • [4] Fast deep reinforcement learning anti-jamming algorithm based on similar sample generation
    Zhou, Quan
    Niu, Yingtao
    Tongxin Xuebao/Journal on Communications, 45 (07): : 117 - 126
  • [5] Intelligent Anti-jamming based on Deep Reinforcement Learning and Transfer Learning
    Janiar, Siavash Barqi
    Wang, Ping
    IEEE Transactions on Vehicular Technology, 1600, (1-10):
  • [6] Reinforcement Learning-Based Anti-Jamming in Networked UAV Radar Systems
    Wu, Qinhao
    Wang, Hongqiang
    Li, Xiang
    Zhang, Bo
    Peng, Jinlin
    APPLIED SCIENCES-BASEL, 2019, 9 (23):
  • [7] A New Anti-jamming Strategy Based on Deep Reinforcement Learning for MANET
    Xu, Yingying
    Lei, Ming
    Li, Min
    Zhao, Minjian
    Hu, Bing
    2019 IEEE 89TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2019-SPRING), 2019,
  • [8] Anti-Jamming Communications Using Spectrum Waterfall: A Deep Reinforcement Learning Approach
    Liu, Xin
    Xu, Yuhua
    Jia, Luliang
    Wu, Qihui
    Anpalagan, Alagan
    IEEE COMMUNICATIONS LETTERS, 2018, 22 (05) : 998 - 1001
  • [9] TWO-DIMENSIONAL ANTI-JAMMING COMMUNICATION BASED ON DEEP REINFORCEMENT LEARNING
    Han, Guoan
    Xiao, Liang
    Poor, H. Vincent
    2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 2087 - 2091
  • [10] Design of Anti-Jamming Waveforms for Cognitive Radar Based on Deep Reinforcement Learning
    Sun, Taohan
    Ma, Xiaomeng
    Zhao, Yangguang
    Xue, Fengtao
    Gao, Meiguo
    2024 6th International Conference on Electronic Engineering and Informatics, EEI 2024, 2024, : 1596 - 1605