Access and Radio Resource Management for IAB Networks Using Deep Reinforcement Learning

被引:6
|
作者
Sande, Malcolm M. [1 ]
Hlophe, Mduduzi C. [1 ]
Maharaj, Bodhaswar T. [1 ]
机构
[1] Univ Pretoria, Dept Elect Elect & Comp Engn, ZA-0028 Pretoria, South Africa
来源
IEEE ACCESS | 2021年 / 9卷
关键词
Congestion control; deep reinforcement learning; integrated access and backhaul; millimeter wave; nearest neighbor; resource allocation; 5G; BACKHAUL; PERSPECTIVE;
D O I
10.1109/ACCESS.2021.3104322
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Congestion in dense traffic networks is a prominent obstacle towards realizing the performance requirements of 5G new radio. Since traditional adaptive traffic signal control cannot resolve this type of congestion, realizing context in the network and adapting resource allocation based on real-time parameters is an attractive approach. This article proposes a radio resource management solution for congestion avoidance on the access side of an integrated access and backhaul (IAB) network using deep reinforcement learning (DRL). The objective of this article is to obtain an optimal policy under which the transmission throughput of all UEs is maximized under the dictates of environmental pressures such as traffic load and transmission power. Here, the resource management problem was converted into a constrained problem using Markov decision processes and dynamic power management, where a deep neural network was trained for optimal power allocation. By initializing a power control parameter, B t , with zero-mean normal distribution, the DRL algorithm adopts a learning policy that aims to achieve logical allocation of resources by placing more emphasis on congestion control and user satisfaction. The performance of the proposed DRL algorithm was evaluated using two learning schemes, i.e., individual learning and nearest neighbor cooperative learning, and this was compared with the performance of a baseline algorithm. The simulation results indicate that the proposed algorithms give better overall performance when compared to the baseline algorithm. From the simulation results, there is a subtle, but critically important insight that brings into focus the fundamental connection between learning rate and the two proposed algorithms. The nearest neighbor cooperative learning algorithm is suitable for IAB networks because its throughput has a good correlation with the congestion rate.
引用
收藏
页码:114218 / 114234
页数:17
相关论文
共 50 条
  • [1] Joint Parameterized Resource Allocation for IAB Networks with Deep Reinforcement Learning
    Hou, Xinwu
    Huang, Yihang
    Xu, Yin
    He, Dazhi
    Zhang, Wenjun
    [J]. 2022 IEEE INTERNATIONAL SYMPOSIUM ON BROADBAND MULTIMEDIA SYSTEMS AND BROADCASTING (BMSB), 2022,
  • [2] Deep Reinforcement Learning Based Dynamic Resource Allocation in Cloud Radio Access Networks
    Rodoshi, Rehenuma Tasnim
    Kim, Taewoon
    Choi, Wooyeol
    [J]. 11TH INTERNATIONAL CONFERENCE ON ICT CONVERGENCE: DATA, NETWORK, AND AI IN THE AGE OF UNTACT (ICTC 2020), 2020, : 618 - 623
  • [3] Deep Reinforcement Learning-Based Mode Selection and Resource Management for Green Fog Radio Access Networks
    Sun, Yaohua
    Peng, Mugen
    Mao, Shiwen
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (02) : 1960 - 1971
  • [4] On Reward Shaping Methods in Deep Reinforcement Learning for Radio Resource Management in Wireless Networks
    Kopic, Amna
    Turbic, Kenan
    Gacanin, Haris
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS, ICC WORKSHOPS, 2023, : 1020 - 1025
  • [5] Radio Resource Scheduling with Deep Pointer Networks and Reinforcement Learning
    AL-Tam, F.
    Mazayev, A.
    Correia, N.
    Rodriguez, J.
    [J]. 2020 IEEE 25TH INTERNATIONAL WORKSHOP ON COMPUTER AIDED MODELING AND DESIGN OF COMMUNICATION LINKS AND NETWORKS (CAMAD), 2020,
  • [6] Deep Reinforcement Learning-based Spectrum Allocation and Power Management for IAB Networks
    Cheng, Qingqing
    Wei, Zhiqiang
    Yuan, Jinhong
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2021,
  • [7] Radio Resource Allocation for 5G Networks Using Deep Reinforcement Learning
    Munaye, Yirga Yayeh
    Lin, Hsin-Piao
    Lin, Ding-Bing
    Juang, Rong-Terng
    Tarekegn, Getaneh Berie
    Jeng, Shiann-Shiun
    [J]. 2021 30TH WIRELESS AND OPTICAL COMMUNICATIONS CONFERENCE (WOCC 2021), 2021, : 66 - 69
  • [8] Deep-Reinforcement-Learning-Based Resource Allocation for Content Distribution in Fog Radio Access Networks
    Fang, Chao
    Xu, Hang
    Yang, Yihui
    Hu, Zhaoming
    Tu, Shanshan
    Ota, Kaoru
    Yang, Zheng
    Dong, Mianxiong
    Han, Zhu
    Yu, F. Richard
    Liu, Yunjie
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (18): : 16874 - 16883
  • [9] Dynamic Reservation and Deep Reinforcement Learning Based Autonomous Resource Slicing for Virtualized Radio Access Networks
    Sun, Guolin
    Gebrekidan, Zemuy Tesfay
    Boateng, Gordon Owusu
    Ayepah-Mensah, Daniel
    Jiang, Wei
    [J]. IEEE ACCESS, 2019, 7 : 45758 - 45772
  • [10] Resource allocation of fog radio access network based on deep reinforcement learning
    Tan, Jingru
    Guan, Wenbo
    [J]. ENGINEERING REPORTS, 2022, 4 (05)