Access and Radio Resource Management for IAB Networks Using Deep Reinforcement Learning

被引:6
|
作者
Sande, Malcolm M. [1 ]
Hlophe, Mduduzi C. [1 ]
Maharaj, Bodhaswar T. [1 ]
机构
[1] Univ Pretoria, Dept Elect Elect & Comp Engn, ZA-0028 Pretoria, South Africa
来源
IEEE ACCESS | 2021年 / 9卷
关键词
Congestion control; deep reinforcement learning; integrated access and backhaul; millimeter wave; nearest neighbor; resource allocation; 5G; BACKHAUL; PERSPECTIVE;
D O I
10.1109/ACCESS.2021.3104322
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Congestion in dense traffic networks is a prominent obstacle towards realizing the performance requirements of 5G new radio. Since traditional adaptive traffic signal control cannot resolve this type of congestion, realizing context in the network and adapting resource allocation based on real-time parameters is an attractive approach. This article proposes a radio resource management solution for congestion avoidance on the access side of an integrated access and backhaul (IAB) network using deep reinforcement learning (DRL). The objective of this article is to obtain an optimal policy under which the transmission throughput of all UEs is maximized under the dictates of environmental pressures such as traffic load and transmission power. Here, the resource management problem was converted into a constrained problem using Markov decision processes and dynamic power management, where a deep neural network was trained for optimal power allocation. By initializing a power control parameter, B t , with zero-mean normal distribution, the DRL algorithm adopts a learning policy that aims to achieve logical allocation of resources by placing more emphasis on congestion control and user satisfaction. The performance of the proposed DRL algorithm was evaluated using two learning schemes, i.e., individual learning and nearest neighbor cooperative learning, and this was compared with the performance of a baseline algorithm. The simulation results indicate that the proposed algorithms give better overall performance when compared to the baseline algorithm. From the simulation results, there is a subtle, but critically important insight that brings into focus the fundamental connection between learning rate and the two proposed algorithms. The nearest neighbor cooperative learning algorithm is suitable for IAB networks because its throughput has a good correlation with the congestion rate.
引用
收藏
页码:114218 / 114234
页数:17
相关论文
共 50 条
  • [31] Random Access Using Deep Reinforcement Learning in Dense Mobile Networks
    Bekele, Yared Zerihun
    Choi, Young-June
    [J]. SENSORS, 2021, 21 (09)
  • [32] Green Deep Reinforcement Learning for Radio Resource Management: Architecture, Algorithm Compression, and Challenges
    Du, Zhiyong
    Deng, Yansha
    Guo, Weisi
    Nallanathan, Arumugam
    Wu, Qihui
    [J]. IEEE VEHICULAR TECHNOLOGY MAGAZINE, 2021, 16 (01): : 29 - 39
  • [33] Mode Selection and Resource Allocation in Sliced Fog Radio Access Networks: A Reinforcement Learning Approach
    Xiang, Hongyu
    Peng, Mugen
    Sun, Yaohua
    Yan, Shi
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (04) : 4271 - 4284
  • [34] Reinforcement learning for radio resource management of hybrid energy cellular networks with battery constraints
    Hassan, Hussein Al Haj
    Jaber, Sahar
    El Amine, Ali
    Nasser, Abbass
    Nuaymi, Loutfi
    [J]. COMPUTER COMMUNICATIONS, 2024, 213 : 135 - 146
  • [35] Collaborative Multi-BS Power Management for Dense Radio Access Network Using Deep Reinforcement Learning
    Chang, Yuchao
    Chen, Wen
    Li, Jun
    Liu, Jianpo
    Wei, Haoran
    Wang, Zhendong
    Al-Dhahir, Naofal
    [J]. IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2023, 7 (04): : 2104 - 2116
  • [36] COUNSEL: Cloud Resource Configuration Management using Deep Reinforcement Learning
    Hegde, Adithya
    Kulkarni, Sameer G.
    Prasad, Abhinandan S.
    [J]. 2023 IEEE/ACM 23RD INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND INTERNET COMPUTING, CCGRID, 2023, : 286 - 298
  • [37] Offline Reinforcement Learning and Cognitive Radio Resource Management for Space-based Radio Access Network Optimization
    Furman, Sean
    Woods, Timothy
    Maracchion, Christopher
    Drozd, Andrew L.
    [J]. 2023 IEEE COGNITIVE COMMUNICATIONS FOR AEROSPACE APPLICATIONS WORKSHOP, CCAAW, 2023,
  • [38] Distributed resource management in wireless sensor networks using reinforcement learning
    Kunal Shah
    Mario Di Francesco
    Mohan Kumar
    [J]. Wireless Networks, 2013, 19 : 705 - 724
  • [39] RADDPG: Resource Allocation in Cognitive Radio with Deep Reinforcement Learning
    Mishra, Nikita
    Srivastava, Sumit
    Sharan, Shivendra Nath
    [J]. 2021 INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS & NETWORKS (COMSNETS), 2021, : 589 - 595
  • [40] Distributed resource management in wireless sensor networks using reinforcement learning
    Shah, Kunal
    Di Francesco, Mario
    Kumar, Mohan
    [J]. WIRELESS NETWORKS, 2013, 19 (05) : 705 - 724