Deep Reinforcement Learning Based Decision Making for Complex Jamming Waveforms

被引:1
|
作者
Xu, Yuting [1 ]
Wang, Chao [1 ]
Liang, Jiakai [1 ]
Yue, Keqiang [1 ,2 ]
Li, Wenjun [1 ]
Zheng, Shilian [2 ]
Zhao, Zhijin [3 ]
机构
[1] Hangzhou Dianzi Univ, Key Lab RF Circuits & Syst, Minist Educ, Hangzhou 310018, Peoples R China
[2] 011 Res Ctr, Sci & Technol Commun Informat Secur Control Lab, Jiaxing 314033, Peoples R China
[3] Hangzhou Dianzi Univ, Sch Commun Engn, Hangzhou 310018, Peoples R China
基金
中国国家自然科学基金;
关键词
cognitive radio; intelligent jamming; deep reinforcement learning; Wolpertinger architecture; soft actor-critic; COGNITIVE RADIO; WIRELESS NETWORKS;
D O I
10.3390/e24101441
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
With the development of artificial intelligence, intelligent communication jamming decision making is an important research direction of cognitive electronic warfare. In this paper, we consider a complex intelligent jamming decision scenario in which both communication parties choose to adjust physical layer parameters to avoid jamming in a non-cooperative scenario and the jammer achieves accurate jamming by interacting with the environment. However, when the situation becomes complex and large in number, traditional reinforcement learning suffers from the problems of failure to converge and a high number of interactions, which are fatal and unrealistic in a real warfare environment. To solve this problem, we propose a deep reinforcement learning based and maximum-entropy-based soft actor-critic (SAC) algorithm. In the proposed algorithm, we add an improved Wolpertinger architecture to the original SAC algorithm in order to reduce the number of interactions and improve the accuracy of the algorithm. The results show that the proposed algorithm shows excellent performance in various scenarios of jamming and achieves accurate, fast, and continuous jamming for both sides of the communication.
引用
下载
收藏
页数:22
相关论文
共 50 条
  • [31] An Algorithm for Jamming Decision Using Dual Reinforcement Learning
    Zhuansun S.
    Yang J.
    Liu H.
    Huang K.
    Yang, Junan, 2018, Xi'an Jiaotong University (52): : 63 - 69
  • [32] Predictive maintenance decision-making for serial production lines based on deep reinforcement learning
    Cui P.
    Wang J.
    Zhang W.
    Li Y.
    Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS, 2021, 27 (12): : 3416 - 3428
  • [33] Network Defense Decision-Making Based on Deep Reinforcement Learning and Dynamic Game Theory
    Huang, Wanwei
    Yuan, Bo
    Wang, Sunan
    Ding, Yi
    Li, Yuhua
    CHINA COMMUNICATIONS, 2023, 21 (09) : 262 - 275
  • [34] A UAV Maneuver Decision-Making Algorithm for Autonomous Airdrop Based on Deep Reinforcement Learning
    Li, Ke
    Zhang, Kun
    Zhang, Zhenchong
    Liu, Zekun
    Hua, Shuai
    He, Jianliang
    SENSORS, 2021, 21 (06)
  • [35] Decision-making Method for Transient Stability Emergency Control Based on Deep Reinforcement Learning
    Li H.
    Zhang P.
    Liu Z.
    Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2023, 47 (05): : 144 - 152
  • [36] Deep Reinforcement Learning Based Game-Theoretic Decision-Making for Autonomous Vehicles
    Yuan, Mingfeng
    Shan, Jinjun
    Mi, Kevin
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02) : 818 - 825
  • [37] Network Defense Decision-Making Based on Deep Reinforcement Learning and Dynamic Game Theory
    Huang Wanwei
    Yuan Bo
    Wang Sunan
    Ding Yi
    Li Yuhua
    China Communications, 2024, 21 (09) : 262 - 275
  • [38] Decision-Making Models for Autonomous Vehicles at Unsignalized Intersections Based on Deep Reinforcement Learning
    Xu, Shu-Yuan
    Chen, Xue-Mei
    Wang, Zi-Jia
    Hu, Yu-Hui
    Han, Xin-Tong
    2022 INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM 2022), 2022, : 672 - 677
  • [39] Improving anti-jamming decision-making strategies for cognitive radar via multi-agent deep reinforcement learning
    Jiang, Wen
    Ren, Yihui
    Wang, Yanping
    DIGITAL SIGNAL PROCESSING, 2023, 135
  • [40] Decision Making Based on Reinforcement Learning and Emotion Learning for Social Behavior
    Matsuda, Atsushi
    Misawa, Hideaki
    Horio, Keiichi
    IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS (FUZZ 2011), 2011, : 2714 - 2719