Deep Reinforcement Learning for Cognitive Radar Spectrum Sharing: A Continuous Control Approach

被引：6

作者：

Flandermeyer, Shane A. ^{[1
]}

Mattingly, Rylee G. ^{[1
]}

Metcalf, Justin G. ^{[1
]}

机构：

[1] The University of Oklahoma, Advanced Radar Research Center (ARRC), The Department of Electrical and Computer Engineering (ECE), Norman,OK,73072, United States

来源：

IEEE Transactions on Radar Systems | 2024年 / 2卷

关键词：

The growing demand for RF spectrum has placed considerable strain on radar systems; which must share limited spectrum resources with an ever-increasing number of devices. It is necessary to design radar systems with coexistence in mind so that the radar avoids harmful mutual interference that compromises the quality of service for other users in the channel. This work presents a deep reinforcement learning (RL) approach to spectrum sharing that enables a pulse-agile radar to operate in heavily congested spectral environments. A cognitive agent dynamically adapts the radar waveform to trade off collision avoidance; bandwidth utilization; and distortion losses due to pulse-agile behavior. Unlike existing RL approaches; this method formulates waveform parameter selection as a continuous control task; significantly increasing the flexibility of the agent and making it possible to scale its behavior to wideband; high-resolution operation. The RL agent uses a recurrent attention-based neural network to select actions; making it suitable for parallelized; real-time implementation. The proposed algorithm makes minimal assumptions about the spectral environment or other users in the spectrum; and the performance of the approach is evaluated on over-the-air data collected from a USRP X310 software-defined radio (SDR) system. Through these experiments; it is shown that the RL approach provides a flexible method for solving multi-objective waveform design problems in dynamic; high-dimensional spectrum environments. © 2023 IEEE;

D O I：

10.1109/TRS.2024.3353112

中图分类号：

学科分类号：

摘要：

引用

页码：125 / 137

共 50 条

[31] Asynchronous Localization for Underwater Acoustic Sensor Networks: A Continuous Control Deep Reinforcement Learning Approach
Zhou, Chengyi
Liu, Meiqin
Zhang, Senlin
Zheng, Ronghao
Dong, Shanling
Liu, Zhunga
IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (06) : 9505 - 9521
[32] A Deep Reinforcement Learning Approach to Traffic Signal Control
Razack, Aquib Junaid
Ajith, Vysyakh
Gupta, Rajiv
2021 IEEE CONFERENCE ON TECHNOLOGIES FOR SUSTAINABILITY (SUSTECH2021), 2021,
[33] A Novel Approach to Feedback Control with Deep Reinforcement Learning
Wang, Yuan
Velswamy, Kirubakaran
Huang, Biao
IFAC PAPERSONLINE, 2018, 51 (18): : 31 - 36
[34] Cooperative Spectrum Sensing Meets Machine Learning: Deep Reinforcement Learning Approach
Sarikhani, Rahil
Keynia, Farshid
IEEE COMMUNICATIONS LETTERS, 2020, 24 (07) : 1459 - 1462
[35] Centralized Spectrum Sharing Using Reinforcement Learning
Yang Miao
Ye Neng
Li Jianguo
Yu Hanxiao
2016 3RD INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND CONTROL ENGINEERING (ICISCE), 2016, : 1275 - 1280
[36] Dynamic spectrum access and sharing through actor-critic deep reinforcement learning
Dong, Liang
Qian, Yuchen
Xing, Yuan
EURASIP JOURNAL ON WIRELESS COMMUNICATIONS AND NETWORKING, 2022, 2022 (01)
[37] Intelligent spectrum sharing for train-to-train communication based on deep reinforcement learning
Zhao, Junhui
Chen, Yao
Zhang, Qingmiao
Journal of Railway Science and Engineering, 2022, 19 (03) : 841 - 848
[38] Deep Reinforcement Learning for UAV-Assisted Spectrum Sharing Under Partial Observability
Zhang, Sigen
Wang, Zhe
Gao, Guanyu
Li, Jun
Zhang, Jie
Yin, Ziyan
2023 IEEE 98TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2023-FALL, 2023,
[39] Dynamic spectrum access and sharing through actor-critic deep reinforcement learning
Liang Dong
Yuchen Qian
Yuan Xing
EURASIP Journal on Wireless Communications and Networking, 2022
[40] Semantic-Aware Spectrum Sharing in Internet of Vehicles Based on Deep Reinforcement Learning
Shao, Zhiyu
Wu, Qiong
Fan, Pingyi
Cheng, Nan
Chen, Wen
Wang, Jiangzhou
Ben Letaief, Khaled
IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (23): : 38521 - 38536

← 1 2 3 4 5 →