Anti-interference frequency allocation based on kernel reinforcement learning

被引：0
|
作者：
Jiang Z. [1 ]
Huang Y. [1 ,2 ]
Wu Q. [1 ]
机构：
[1] Key Laboratory of Ministry of Industry and Information Technology on Electromagnetic Spectrum Spatial Cognitive Dynamic Systems, Nanjing University of Aeronautics and Astronautics, Nanjing
[2] National Mobile Communications Research Laboratory, Southeast University, Nanjing
来源：
Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics | 2021年 / 43卷 / 06期
关键词：
Anti-interference; Kernel method; Q-learning; Reinforcement learning;
D O I：
10.12305/j.issn.1001-506X.2021.06.12
中图分类号：
学科分类号：
摘要：
Aiming at the problem of learning unknown dynamic interference patterns, a frequency point cooperation algorithm for radar and communication anti-interference based on kernel function reinforcement learning is proposed. On the contrary, the proposed algorithm can optimize the anti-interference frequency allocation strategy by using the usage of the intermediate frequency points in the past slots. Firstly, the problem of curse of dimensions is solved by reinforcement learning of kernel function. Secondly, the online kernel sparsity method based on approximate linear correlation ensures the sparsity of anti-interference frequency assignment algorithm. Finally, simulation results verify the effectiveness of the proposed algorithm. Due to the learning of sparse codewords for the dynamic characteristics of the system, compared with the traditional anti-interference frequency assignment algorithm based on Q-learning, the proposed algorithm has shorter convergence time and can quickly avoid the interference of external unknown interference sources. © 2021, Editorial Office of Systems Engineering and Electronics. All right reserved.
引用
收藏
页码：1547 / 1556
页数：9
相关论文
共 27 条
  • [1] TARIQ F, KHANDAKER M R A, WONG K K, Et al., A speculative study on 6G, IEEE Wireless Communications, 27, 4, pp. 118-125, (2020)
  • [2] Facilitating opportunities for flexible, efficient, and reliable spectrum use employing cognitive radio technologies, Et Docket, 3, 108, pp. 5-57, (2003)
  • [3] LETAIEF K B, CHEN W, SHI Y, Et al., The roadmap to 6G: AI empowered wireless networks, IEEE Communications Magazine, 57, 8, pp. 84-90, (2019)
  • [4] ZOU Y L, WANG X B, HANZO L, Et al., A survey on wireless security: technical challenges, recent advances, and future trends, Proceedings of the IEEE, 104, 9, pp. 1727-1765, (2016)
  • [5] YAO F Q., Communication anti-jamming engineering and practice, (2012)
  • [6] ZHANG L Y, GUAN Z Y, MELODIA T., United against the enemy: anti-jamming based on cross-layer cooperation in wireless networks, IEEE Trans.on Wireless Communications, 15, 8, pp. 5733-5747, (2016)
  • [7] LIU X, XU Y H, JIA L L, Et al., Anti-jamming communications using spectrum waterfall: a deep reinforcement learning approach, IEEE Communications Letters, 22, 5, pp. 998-1001, (2018)
  • [8] WU Y, WANG B, LIU K J, Et al., Anti-jamming games in multi-channel cognitive radio networks, IEEE Journal on Selected Areas in Communications, 30, 1, pp. 4-15, (2011)
  • [9] YANG D J, XUE G L, ZHANG J, Et al., Coping with a smart jammer in wireless networks: a Stackelberg game approach, IEEE Trans.on Wireless Communications, 12, 8, pp. 4038-4047, (2013)
  • [10] SAGDUYU Y E, BERRY R A, EPHREMIDES A., Jamming games in wireless networks with incomplete information, IEEE Communications Magazine, 49, 8, pp. 112-118, (2011)
123