Meta Reinforcement Learning-Based Spectrum Sharing Between RIS-Assisted Cellular Communications and MIMO Radar

被引:1
|
作者
Saikia, Prajwalita [1 ]
Singh, Keshav [1 ]
Taghizadeh, Omid [2 ]
Huang, Wan-Jen [1 ]
Biswas, Sudip [3 ]
机构
[1] Natl Sun Yat Sen Univ, Inst Commun Engn, Kaohsiung 804, Taiwan
[2] Lenovo Deutschland GmbH, 5G Wireless Res Grp, D-70563 Stuttgart, Germany
[3] Indian Inst Informat Technol Guwahati, Dept Elect & Commun Engn, Gauhati 781015, India
关键词
Radar; Interference; Optimization; MIMO radar; Communication systems; Heuristic algorithms; Wireless communication; Meta reinforcement learning (MRL); multiple-input multiple-output (MIMO); spectrum sharing; reconfigurable intelligent surface (RIS); SYSTEMS; DESIGN; COEXISTENCE; TRACKING; ACCESS;
D O I
10.1109/TCCN.2023.3319543
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
New wireless networks together with fixed spectrum allocation have resulted in spectrum paucity, which has led to the idea of spectrum sharing between radar and communication systems. In this work, we consider a spectrum-sharing framework between a reconfigurable intelligent surface (RIS)-assisted cellular system and a multiple-input multiple-output (MIMO) radar and investigate its performance. In particular, we formulate an optimization problem to jointly optimize the communication transmit precoder matrix, RIS phase shift matrix, and transmit waveform of radar while maintaining the operational fairness of the proposed system, including the limitation on permissible interference towards the radar system. Thereafter, to address the non-convexity of the problem, we propose a low-complexity meta-reinforcement learning (MRL) algorithm that solves the problem in continuous action spaces by reducing the overall training overhead. Exhaustive simulation results are presented that demonstrate the benefit of using the MRL algorithm for the proposed spectrum-sharing framework along with the utility of the deployment of RIS in terms of controlling the interference from the base station to the radar. It is also shown that the proposed MRL technique outperforms traditional block coordinate descent (BCD)-based solutions, meta-heuristic approaches and other reinforcement learning (RL) algorithms such as twin delayed deep deterministic (TD3) and deep deterministic policy gradient (DDPG).
引用
收藏
页码:164 / 179
页数:16
相关论文
共 50 条
  • [41] Reinforcement Learning-Based Intelligent Reflecting Surface Assisted Communications Against Smart Attackers
    Li, Baogang
    Shi, Tai
    Zhao, Wei
    Wang, Ning
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2022, 70 (07) : 4771 - 4779
  • [42] Reinforcement Learning-Based Power Sharing Between Batteries and Supercapacitors in Electric Vehicles
    Abdelhedi, Riadh
    Lahyani, Amine
    Ammari, Ahmed Chiheb
    Sari, Ali
    Venet, Pascal
    2018 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY (ICIT), 2018, : 2072 - 2077
  • [43] Energy Harvesting UAV-RIS-Assisted Maritime Communications Based on Deep Reinforcement Learning Against Jamming
    Yang H.
    Lin K.
    Xiao L.
    Zhao Y.
    Xiong Z.
    Han Z.
    IEEE Transactions on Wireless Communications, 2024, 23 (08) : 1 - 1
  • [44] Deep Reinforcement Learning Assisted Multi-Operator Spectrum Sharing in Cell-Free MIMO Networks
    Shin, Minsu
    Mughal, Danish Mehmood
    Kim, Sang-Hyo
    Chung, Min Young
    IEEE Communications Letters, 2024, 28 (12) : 2894 - 2898
  • [45] Deep Reinforcement Learning-Based Resource Allocation for Cellular V2X Communications
    Chung, Yi-Ching
    Chang, Hsin-Yuan
    Chang, Ronald Y.
    Chung, Wei -Ho
    2023 IEEE 97TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2023-SPRING, 2023,
  • [46] Multi-Agent Deep Reinforcement Learning Based Optimizing Joint 3D Trajectories and Phase Shifts in RIS-Assisted UAV-Enabled Wireless Communications
    Tesfaw, Belayneh Abebe
    Juang, Rong-Terng
    Lin, Hsin-Piao
    Tarekegn, Getaneh Berie
    Kabore, Wendenda Nathanael
    IEEE Open Journal of Vehicular Technology, 2024, 5 : 1712 - 1726
  • [47] Cache Sharing in UAV-Enabled Cellular Network: A Deep Reinforcement Learning-Based Approach
    Muslih, Hamidullah
    Kazmi, S. M. Ahsan
    Mazzara, Manuel
    Baye, Gaspard
    IEEE ACCESS, 2024, 12 : 43422 - 43435
  • [48] Deep reinforcement learning-based multi-channel spectrum sharing technology for next generation multi-operator cellular networks
    Shin, Minsu
    Mahboob, Tahira
    Mughal, Danish Mehmood
    Chung, Min Young
    WIRELESS NETWORKS, 2023, 29 (02) : 809 - 820
  • [49] Deep Reinforcement Learning Assisted Spectrum Management in Cellular Based Urban Air Mobility
    Han, Ruixuan
    Li, Hongxiang
    Apaza, Rafael
    Knoblock, Eric
    Gasper, Michael
    IEEE WIRELESS COMMUNICATIONS, 2022, 29 (06) : 14 - 21
  • [50] Dynamic Spectrum Sharing in Cellular Based Urban Air Mobility via Deep Reinforcement Learning
    Han, Ruixuan
    Li, Hongxiang
    Knoblock, Eric J.
    Gasper, Michael R.
    Apaza, Rafael D.
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 1332 - 1337