Joint Optimization of IRS-assisted MU-MIMO Communication Systems through a DRL-based Twin Delayed DDPG Approach

被引:6
|
作者
Pereira-Ruisanchez, Dariel [1 ]
Fresnedo, Oscar [1 ]
Perez-Adan, Darian [1 ]
Castedo, Luis [1 ]
机构
[1] Univ A Coruna, Dept Comp Engn CITIC Res Ctr, Coruna, Spain
关键词
deep reinforcement learning; TD3; MU-MIMO; intelligent reflecting surfaces; INTELLIGENT REFLECTING SURFACE; ENERGY;
D O I
10.1109/BMSB55706.2022.9828652
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Intelligent reflecting surface (IRS)-assisted multipleinput multiple-output (MIMO) systems are foreseen as key enablers of beyond 5G (B5G) and 6G wireless communications. By properly designing the MIMO precoding matrices and the IRS phase-shift matrix, the system performance significantly improves in terms of higher transmission rates, lower power consumption and delays, and improved communication security. To overcome the high dimensionality of the joint optimization of the precoders and the IRS phase shift matrix, we propose an innovative deep reinforcement learning (DRL)-based approach. We aim at maximizing the system sum-rate by considering an adaptation of the deep deterministic policy gradient (DDPG) framework, namely twin delayed DDPG (TD3). Hence, the optimization problem is formulated in terms of continuous action and state spaces, while artificial neural networks (ANNs) are used for the function approximations. The simulation results show that the proposed solution reaches a competitive performance when compared with other state-of-the-art algorithms.
引用
收藏
页数:6
相关论文
共 10 条
  • [1] DRL-Based Sequential Scheduling for IRS-Assisted MIMO Communications
    Pereira-Ruisanchez, Dariel
    Fresnedo, Oscar
    Perez-Adan, Darian
    Castedo, Luis
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (06) : 8445 - 8459
  • [2] Robust Design for IRS-Assisted MISO-NOMA Systems: A DRL-Based Approach
    Waraiet, Abdulhamed
    Cumanan, Kanapathippillai
    Ding, Zhiguo
    Dobre, Octavia A.
    [J]. IEEE WIRELESS COMMUNICATIONS LETTERS, 2024, 13 (03) : 592 - 596
  • [3] Deep Contextual Bandit and Reinforcement Learning for IRS-Assisted MU-MIMO Systems
    Pereira-Ruisanchez, Dariel
    Fresnedo, Oscar
    Perez-Adan, Darian
    Castedo, Luis
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (07) : 9099 - 9114
  • [4] DRL-based joint optimization for 3D-oriented multi-IRS communication systems
    Khan, Muhammad Fawad
    Peng, Limei
    Ho, Pin -Han
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2024, 114
  • [5] Passive Beamforming for IRS-Assisted MU-MIMO Systems With One-Bit ADCs: An SER Minimization Design Approach
    Zheng, Yiran
    Lin, Tian
    Zhu, Yu
    [J]. IEEE COMMUNICATIONS LETTERS, 2022, 26 (05) : 1101 - 1105
  • [6] Joint Optimization of IRS-Assisted Multiuser MIMO Systems With Low-Resolution DACs
    Chen, Junxian
    Tan, Weiqiang
    Yang, Longcheng
    Li, Chunguo
    [J]. IEEE SENSORS JOURNAL, 2024, 24 (07) : 11574 - 11584
  • [7] Joint Active and Passive Beamforming Design for IRS-Assisted Multi-User MIMO Systems: A VAMP-Based Approach
    Rehman, Haseeb Ur
    Bellili, Faouzi
    Mezghani, Amine
    Hossain, Ekram
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 2021, 69 (10) : 6734 - 6749
  • [8] Joint Service Caching, Communication and Computing Resource Allocation in Collaborative MEC Systems: A DRL-Based Two-Timescale Approach
    Liu, Qianqian
    Zhang, Haixia
    Zhang, Xin
    Yuan, Dongfeng
    [J]. IEEE Transactions on Wireless Communications, 2024, 23 (10) : 15493 - 15506
  • [9] Joint Iterative Optimization-Based Low-Complexity Adaptive Hybrid Beamforming for Massive MU-MIMO Systems
    Ruan, Hang
    Xiao, Pei
    Xiao, Lixia
    Kelly, James R.
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 2021, 69 (03) : 1707 - 1722
  • [10] Two-Timescale Beamforming for IRS-Assisted Millimeter Wave Systems: A Deep Unrolling-Based Stochastic Optimization Approach
    Wang, Peilan
    Fang, Jun
    Wu, Zhuoran
    Li, Hongbin
    [J]. 2022 IEEE 12TH SENSOR ARRAY AND MULTICHANNEL SIGNAL PROCESSING WORKSHOP (SAM), 2022, : 191 - 195