Deep Reinforcement Learning Based Decision Making for Complex Jamming Waveforms

被引:1
|
作者
Xu, Yuting [1 ]
Wang, Chao [1 ]
Liang, Jiakai [1 ]
Yue, Keqiang [1 ,2 ]
Li, Wenjun [1 ]
Zheng, Shilian [2 ]
Zhao, Zhijin [3 ]
机构
[1] Hangzhou Dianzi Univ, Key Lab RF Circuits & Syst, Minist Educ, Hangzhou 310018, Peoples R China
[2] 011 Res Ctr, Sci & Technol Commun Informat Secur Control Lab, Jiaxing 314033, Peoples R China
[3] Hangzhou Dianzi Univ, Sch Commun Engn, Hangzhou 310018, Peoples R China
基金
中国国家自然科学基金;
关键词
cognitive radio; intelligent jamming; deep reinforcement learning; Wolpertinger architecture; soft actor-critic; COGNITIVE RADIO; WIRELESS NETWORKS;
D O I
10.3390/e24101441
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
With the development of artificial intelligence, intelligent communication jamming decision making is an important research direction of cognitive electronic warfare. In this paper, we consider a complex intelligent jamming decision scenario in which both communication parties choose to adjust physical layer parameters to avoid jamming in a non-cooperative scenario and the jammer achieves accurate jamming by interacting with the environment. However, when the situation becomes complex and large in number, traditional reinforcement learning suffers from the problems of failure to converge and a high number of interactions, which are fatal and unrealistic in a real warfare environment. To solve this problem, we propose a deep reinforcement learning based and maximum-entropy-based soft actor-critic (SAC) algorithm. In the proposed algorithm, we add an improved Wolpertinger architecture to the original SAC algorithm in order to reduce the number of interactions and improve the accuracy of the algorithm. The results show that the proposed algorithm shows excellent performance in various scenarios of jamming and achieves accurate, fast, and continuous jamming for both sides of the communication.
引用
下载
收藏
页数:22
相关论文
共 50 条
  • [1] Deep reinforcement learning based decision making for radar jamming suppression
    Xiao Y.
    Cao Z.
    Yu X.
    Jiang Y.
    Digital Signal Processing: A Review Journal, 2024, 151
  • [2] Design of Anti-Jamming Waveforms for Cognitive Radar Based on Deep Reinforcement Learning
    Sun, Taohan
    Ma, Xiaomeng
    Zhao, Yangguang
    Xue, Fengtao
    Gao, Meiguo
    2024 6th International Conference on Electronic Engineering and Informatics, EEI 2024, 2024, : 1596 - 1605
  • [3] An intelligent decision-making method for anti-jamming communication based on deep reinforcement learning
    Song B.
    Xu H.
    Jiang L.
    Rao N.
    Xibei Gongye Daxue Xuebao/Journal of Northwestern Polytechnical University, 2021, 39 (03): : 641 - 649
  • [4] A Collaborative Communication Jamming Decision Algorithm Based on Deep Reinforcement Learning
    Song B.-L.
    Xu H.
    Qi Z.-S.
    Rao N.
    Peng X.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2022, 50 (06): : 1301 - 1309
  • [5] An Intelligent Anti-jamming Decision-making Method Based on Deep Reinforcement Learning for Cognitive Radar
    Jiang, Wen
    Wang, Yanping
    Li, Yang
    Lin, Yun
    Shen, Wenjie
    Proceedings of the 2023 26th International Conference on Computer Supported Cooperative Work in Design, CSCWD 2023, 2023, : 1662 - 1666
  • [6] A Decision-making Approach for Complex Unsignalized Intersection by Deep Reinforcement Learning
    Li S.
    Peng K.
    Hui F.
    Li Z.
    Wei C.
    Wang W.
    IEEE Transactions on Vehicular Technology, 2024, 73 (11) : 1 - 14
  • [7] Uncertainty-based Decision Making Using Deep Reinforcement Learning
    Zhao, Xujiang
    Hu, Shu
    Cho, Jin-Hee
    Chen, Feng
    2019 22ND INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION 2019), 2019,
  • [8] An Anti-jamming Intelligent Decision-Making Method for Multi-user Communication Based on Deep Reinforcement Learning
    Zhang, Lan
    Ma, Liang
    Tian, Feng
    Liang, Tianyi
    International Conference on Communication Technology Proceedings, ICCT, 2022, 2022-November-November : 1335 - 1339
  • [9] A cooperative jamming decision-making method based on multi-agent reinforcement learning
    Bingchen Cai
    Haoran Li
    Naimin Zhang
    Mingyu Cao
    Han Yu
    Autonomous Intelligent Systems, 5 (1):
  • [10] Design of Cognitive Jamming Decision-Making System Against MFR Based on Reinforcement Learning
    Zhang, Wenxu
    Ma, Dan
    Zhao, Zhongkai
    Liu, Feiran
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (08) : 10048 - 10062