Deep Reinforcement Learning Based Decision Making for Complex Jamming Waveforms

被引:1
|
作者
Xu, Yuting [1 ]
Wang, Chao [1 ]
Liang, Jiakai [1 ]
Yue, Keqiang [1 ,2 ]
Li, Wenjun [1 ]
Zheng, Shilian [2 ]
Zhao, Zhijin [3 ]
机构
[1] Hangzhou Dianzi Univ, Key Lab RF Circuits & Syst, Minist Educ, Hangzhou 310018, Peoples R China
[2] 011 Res Ctr, Sci & Technol Commun Informat Secur Control Lab, Jiaxing 314033, Peoples R China
[3] Hangzhou Dianzi Univ, Sch Commun Engn, Hangzhou 310018, Peoples R China
基金
中国国家自然科学基金;
关键词
cognitive radio; intelligent jamming; deep reinforcement learning; Wolpertinger architecture; soft actor-critic; COGNITIVE RADIO; WIRELESS NETWORKS;
D O I
10.3390/e24101441
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
With the development of artificial intelligence, intelligent communication jamming decision making is an important research direction of cognitive electronic warfare. In this paper, we consider a complex intelligent jamming decision scenario in which both communication parties choose to adjust physical layer parameters to avoid jamming in a non-cooperative scenario and the jammer achieves accurate jamming by interacting with the environment. However, when the situation becomes complex and large in number, traditional reinforcement learning suffers from the problems of failure to converge and a high number of interactions, which are fatal and unrealistic in a real warfare environment. To solve this problem, we propose a deep reinforcement learning based and maximum-entropy-based soft actor-critic (SAC) algorithm. In the proposed algorithm, we add an improved Wolpertinger architecture to the original SAC algorithm in order to reduce the number of interactions and improve the accuracy of the algorithm. The results show that the proposed algorithm shows excellent performance in various scenarios of jamming and achieves accurate, fast, and continuous jamming for both sides of the communication.
引用
下载
收藏
页数:22
相关论文
共 50 条
  • [41] A New Anti-jamming Strategy Based on Deep Reinforcement Learning for MANET
    Xu, Yingying
    Lei, Ming
    Li, Min
    Zhao, Minjian
    Hu, Bing
    2019 IEEE 89TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2019-SPRING), 2019,
  • [42] Deep Reinforcement Learning based Multi-user Anti jamming Strategy
    Bi, Yue
    Wu, Yue
    Hua, Cunqing
    ICC 2019 - 2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2019,
  • [43] Design of Jamming-Detection Shared Signal Based on Deep Reinforcement Learning
    Xiao Y.
    Liu Y.
    Yu X.
    Zhao Z.
    Tianjin Daxue Xuebao (Ziran Kexue yu Gongcheng Jishu Ban)/Journal of Tianjin University Science and Technology, 2023, 56 (12): : 1326 - 1336
  • [44] Adversarial Jamming Attacks on Deep Reinforcement Learning Based Dynamic Multichannel Access
    Zhong, Chen
    Wang, Feng
    Gursoy, M. Cenk
    Velipasalar, Senem
    2020 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2020,
  • [45] Sensitivity of Dynamic Network Slicing to Deep Reinforcement Learning Based Jamming Attacks
    Wang, Feng
    Gursoy, M. Cenk
    Velipasalar, Senem
    2023 IEEE 34TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS, PIMRC, 2023,
  • [46] A Dynamic Adaptive Jamming Power Allocation Method Based on Deep Reinforcement Learning
    Peng X.
    Xu H.
    Jiang L.
    Zhang Y.
    Rao N.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2023, 51 (05): : 1223 - 1234
  • [47] Hierarchical reinforcement learning and decision making
    Botvinick, Matthew Michael
    CURRENT OPINION IN NEUROBIOLOGY, 2012, 22 (06) : 956 - 962
  • [48] Modeling Complex Networks Based on Deep Reinforcement Learning
    Song, Wenbo
    Sheng, Wei
    Li, Dong
    Wu, Chong
    Ma, Jun
    FRONTIERS IN PHYSICS, 2022, 9
  • [49] Improved deep reinforcement learning for car-following decision-making
    Yang, Xiaoxue
    Zou, Yajie
    Zhang, Hao
    Qu, Xiaobo
    Chen, Lei
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2023, 624
  • [50] Combining Planning and Deep Reinforcement Learning in Tactical Decision Making for Autonomous Driving
    Hoel, Carl-Johan
    Driggs-Campbell, Katherine
    Wolff, Krister
    Laine, Leo
    Kochenderfer, Mykel J.
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2020, 5 (02): : 294 - 305