Deep Reinforcement Learning for Cognitive Radar Spectrum Sharing: A Continuous Control Approach

被引：6
|
作者：
Flandermeyer, Shane A. [1 ]
Mattingly, Rylee G. [1 ]
Metcalf, Justin G. [1 ]
机构：
[1] The University of Oklahoma, Advanced Radar Research Center (ARRC), The Department of Electrical and Computer Engineering (ECE), Norman,OK,73072, United States
来源：
IEEE Transactions on Radar Systems | 2024年 / 2卷
关键词：
The growing demand for RF spectrum has placed considerable strain on radar systems; which must share limited spectrum resources with an ever-increasing number of devices. It is necessary to design radar systems with coexistence in mind so that the radar avoids harmful mutual interference that compromises the quality of service for other users in the channel. This work presents a deep reinforcement learning (RL) approach to spectrum sharing that enables a pulse-agile radar to operate in heavily congested spectral environments. A cognitive agent dynamically adapts the radar waveform to trade off collision avoidance; bandwidth utilization; and distortion losses due to pulse-agile behavior. Unlike existing RL approaches; this method formulates waveform parameter selection as a continuous control task; significantly increasing the flexibility of the agent and making it possible to scale its behavior to wideband; high-resolution operation. The RL agent uses a recurrent attention-based neural network to select actions; making it suitable for parallelized; real-time implementation. The proposed algorithm makes minimal assumptions about the spectral environment or other users in the spectrum; and the performance of the approach is evaluated on over-the-air data collected from a USRP X310 software-defined radio (SDR) system. Through these experiments; it is shown that the RL approach provides a flexible method for solving multi-objective waveform design problems in dynamic; high-dimensional spectrum environments. © 2023 IEEE;
D O I：
10.1109/TRS.2024.3353112
中图分类号：
学科分类号：
摘要：
引用
收藏
页码：125 / 137
相关论文
共 50 条
  • [21] A Reinforcement Learning Approach for Wireless Backhaul Spectrum Sharing in IoE HetNets
    Jaber, Mona
    Alam, Atm Shafiul
    2020 IEEE 31ST ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (IEEE PIMRC), 2020,
  • [22] Reconfigurable and Adaptive Radar Amplifiers for Spectrum Sharing in Cognitive Radar
    Baylis, Charles
    Egbert, Austin
    Alcala-Medel, Jose
    Dockendorf, Angelique
    Calabrese, Caleb
    Langley, Ellie
    Martone, Anthony
    Gallagher, Kyle
    Viveiros, Ed
    Peroulis, Dimitrios
    Semnani, Abbas
    Marks, Robert J., II
    2019 IEEE RADAR CONFERENCE (RADARCONF), 2019,
  • [23] Dynamic Spectrum Sharing Based on Deep Reinforcement Learning in Mobile Communication Systems
    Liu, Sizhuang
    Pan, Changyong
    Zhang, Chao
    Yang, Fang
    Song, Jian
    SENSORS, 2023, 23 (05)
  • [24] An overview of deep reinforcement learning for spectrum sensing in cognitive radio networks
    Obite, Felix
    Usman, Aliyu D.
    Okafor, Emmanuel
    DIGITAL SIGNAL PROCESSING, 2021, 113
  • [25] An overview of deep reinforcement learning for spectrum sensing in cognitive radio networks
    Obite, Felix
    Usman, Aliyu D.
    Okafor, Emmanuel
    Digital Signal Processing: A Review Journal, 2021, 113
  • [26] Cognitive Radio Spectrum Sensing and Prediction Using Deep Reinforcement Learning
    Jalil, Syed Qaisar
    Chalup, Stephan
    Rehmani, Mubashir Husain
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [27] Continuous Control of an Underground Loader Using Deep Reinforcement Learning
    Backman, Sofi
    Lindmark, Daniel
    Bodin, Kenneth
    Servin, Martin
    Mork, Joakim
    Lofgren, Hakan
    MACHINES, 2021, 9 (10)
  • [28] A DEEP REINFORCEMENT LEARNING APPROACH FOR INTEGRATED AUTOMOTIVE RADAR SENSING AND COMMUNICATION
    Xu, Lifan
    Zheng, Ruxin
    Sun, Shunqiao
    2022 IEEE 12TH SENSOR ARRAY AND MULTICHANNEL SIGNAL PROCESSING WORKSHOP (SAM), 2022, : 316 - 320
  • [29] Continuous Control with Deep Reinforcement Learning for Mobile Robot Navigation
    Xiang, Jiaqi
    Li, Qingdong
    Dong, Xiwang
    Ren, Zhang
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 1501 - 1506
  • [30] A sharing deep reinforcement learning method for efficient vehicle platooning control
    Lu, Sikai
    Cai, Yingfeng
    Chen, Long
    Wang, Hai
    Sun, Xiaoqiang
    Jia, Yunyi
    IET INTELLIGENT TRANSPORT SYSTEMS, 2022, 16 (12) : 1697 - 1709
12345