Reinforcement Learning Based Power Allocation for 6G Heterogenous Networks

被引:0
|
作者
Alhashimi, Hayder Faeq [1 ]
Hindia, Mhd Nour [1 ]
Dimyati, Kaharudin [1 ]
Hanafi, Effariza Binti [1 ]
Izam, Tengku Faiz Tengku Mohmed Noor [1 ]
机构
[1] UM, Fac Engn, Dept Elect Engn, Ctr Adv Commun Res & Innovat ACRI, Kuala Lumpur 50603, Malaysia
关键词
Reinforcement learning (RL); Power allocation; heterogenous networks (HetNets); SARSA; Quality of Service (QoS);
D O I
10.1007/978-3-031-60994-7_11
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Heterogeneous networks (HetNets) play a crucial role in the context of 6G cellular networks, serving as a significant enabler for enhanced capacity and coverage. Nevertheless, the performance of multi-tiered architecture is impacted by interferences. While many strategies have been suggested to address interference management in HetNets and optimize power allocation, the challenge of concurrently ensuring quality of service (QoS) for both macro cell and small cell user equipment remains an ongoing area of study. The effectiveness of intelligent power distribution algorithms in HetNets has been shown by their inherent self-optimization abilities. In this paper, a power allocation strategy that is based on Reinforcement Learning (RL) is developed for relay-assisted HetNets. The proposed RL methodology aims to efficiently distribute power resources to the macro cell base station (MBS) and small cell base station (SBS) in order to satisfy the minimal capacity requirements of both macro cell user equipment (MUEs) and small cell user equipment (SUEs), hence ensuring the provision of adequate QoS. The RL algorithm under consideration maintains the minimum requirement of MUE and SUE along with a significant increase in their capacities. The modeling of a cellular network as a multi-agent network is achieved by attributing the role of an agent to each base station (BS). BS engage in interactions with adjacent BSs to facilitate the sharing of information and undertake self-optimization processes guided by an integrated rewards function. The simulation results demonstrate the efficiency and superiority of the proposed algorithm compared to the benchmark schemes.
引用
收藏
页码:128 / 141
页数:14
相关论文
共 50 条
  • [1] Collective reinforcement learning based resource allocation for digital twin service in 6G networks
    Huang, Zhongwei
    Li, Dagang
    Cai, Jun
    Lu, Hua
    [J]. JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2023, 217
  • [2] Resource allocation strategy based on deep reinforcement learning in 6G dense network
    Yang F.
    Yang C.
    Huang J.
    Zhang S.
    Yu T.
    Zuo X.
    Yang C.
    [J]. Tongxin Xuebao/Journal on Communications, 2023, 44 (08): : 215 - 227
  • [3] UAV-Assisted 5G/6G Networks: Joint Scheduling and Resource Allocation Based on Asynchronous Reinforcement Learning
    Yang, Helin
    Zhao, Jun
    Nie, Jiangtian
    Kumar, Neeraj
    Lam, Kwok-Yan
    Xiong, Zehui
    [J]. IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (IEEE INFOCOM WKSHPS 2021), 2021,
  • [4] Seamless and Intelligent Resource Allocation in 6G Maritime Networks Framework via Deep Reinforcement Learning
    Hassan, Sheikh Salman
    Park, Seong-Bae
    Huh, Eui-Nam
    Hong, Choong Seon
    [J]. 2023 INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING, ICOIN, 2023, : 505 - 510
  • [5] A Deep Reinforcement Learning based Routing Scheme for LEO Satellite Networks in 6G
    Hsu, Yi-Huai
    Lee, Jiun-Ian
    Xu, Feng-Ming
    [J]. 2023 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC, 2023,
  • [6] Toward Reinforcement-Learning-Based Intelligent Network Control in 6G Networks
    Li, Junling
    Wu, Huaqing
    Huang, Xi
    Huang, Qisheng
    Huang, Jianwei
    Shen, Xuemin
    [J]. IEEE NETWORK, 2023, 37 (04): : 104 - 111
  • [7] Energy-efficient Resource Allocation for the 6G Computing Network Based on Deep Reinforcement Learning
    Leng, Yunju
    Cui, Kuo
    Liu, Jinyang
    Liu, Yitong
    Gao, Yuehong
    Wang, Qixing
    Yang, Hongwen
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS, ICC WORKSHOPS, 2023, : 631 - 636
  • [8] Deep Reinforcement Learning-Based Adaptive Beam Tracking and Resource Allocation in 6G Vehicular Networks with Switched Beam Antennas
    Ahmed, Tahir H.
    Tiang, Jun Jiat
    Mahmud, Azwan
    Gwo Chin, Chung
    Do, Dinh-Thuan
    [J]. ELECTRONICS, 2023, 12 (10)
  • [9] Federated Deep Reinforcement Learning for Open RAN Slicing in 6G Networks
    Abouaomar, Amine
    Taik, Afaf
    Filali, Abderrahime
    Cherkaoui, Soumaya
    [J]. IEEE COMMUNICATIONS MAGAZINE, 2023, 61 (02) : 126 - 132
  • [10] Power Allocation for 6G Sub-networks in Industrial Wireless Control
    Li, Dong
    Khosravirad, Saeed R.
    Tao, Tao
    Baracca, Paolo
    Wen, Pingping
    [J]. 2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,