Actor Critic Based Reinforcement Learning for Joint Resource Allocation and Throughput Maximization in 5G RAN Slicing

被引:0
|
作者
Kulkarni, Dhanashree [1 ]
Venkatesan, Mithra [1 ]
Kulkarni, Anju V. [2 ]
机构
[1] Dr DY Patil Inst Technol, Elect & Telecommun, Pune, India
[2] Dayananda Sagar Coll Engn, Elect & Telecommun, Bangalore, India
关键词
Network slicing; Deep actor critic reinforcement learning-network slicing; Resource allocation; FRAMEWORK;
D O I
10.1007/s11277-024-11526-0
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
With the advent of fifth generation (5G) mobile communication network slicing technology, the range of application scenarios is expanding significantly. For 5G to function well, it necessitates little delay, a fast rate of data transfer, and the ability to handle a large number of connections. This demanding service requires the allocation of resources in a dynamic manner, while maintaining a very high level of reliability in terms of Quality of Service (QoS).The applications like autonomous driving, telesurgery, etc. have stringent QoS demands and the present design of slices is not suitable for these services. Therefore, latency has been regarded as a crucial factor in the design of the slices. Conventional optimization algorithms often lack robustness and adaptability to dynamic environments, getting stuck in local optima and failing to generalize to varying conditions. Our solution utilizes Reinforcement Learning (RL) to allocate resources to the slices. The utilization of restricted resources can be optimized through the reconfiguration of slices. The ability of RL to acquire knowledge from the surroundings enables our solution to adjust to varying network conditions, enhance the allocation of resources and improve quality of service over a period of time for different network slices. This study introduces the Deep Actor Critic Reinforcement Learning- Network Slicing (DACRL-NS) technique, which utilizes Deep Actor Critic Reinforcement learning for efficient resource allocation to network slices. The objective is to achieve optimal throughput in the network. If the slices fail to meet the minimum criteria, they will be omitted from the allocation. With increasing training episodes, our Actor-Critic algorithm enhances average cumulative rewards and resource allocation efficiency, demonstrating continuous learning and improved decision-making.The simulated suggested system demonstrates an average throughput improvement of 8.92% and 16.36% with respect to the rate requirement and latency requirement, respectively. The data also demonstrate a 17.14% increase in the overall network throughput.
引用
收藏
页码:623 / 640
页数:18
相关论文
共 50 条
  • [41] Actor-Critic-Based Learning for Zero-touch Joint Resource and Energy Control in Network Slicing
    Rezazadeh, Farhad
    Chergui, Hatim
    Christofi, Loizos
    Verikoukis, Christos
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
  • [42] Reinforcement Learning for Dynamic Resource Optimization in 5G Radio Access Network Slicing
    Shi, Yi
    Sagduyu, Yalin E.
    Erpek, Tugba
    2020 IEEE 25TH INTERNATIONAL WORKSHOP ON COMPUTER AIDED MODELING AND DESIGN OF COMMUNICATION LINKS AND NETWORKS (CAMAD), 2020,
  • [43] An optimal multitier resource allocation of cloud RAN in 5G using machine learning
    Bashir, Ali Kashif
    Arul, Rajakumar
    Basheer, Shakila
    Raja, Gunasekaran
    Jayaraman, Ramkumar
    Qureshi, Nawab Muhammad Faseeh
    TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES, 2019, 30 (08)
  • [44] UAV-Assisted 5G/6G Networks: Joint Scheduling and Resource Allocation Based on Asynchronous Reinforcement Learning
    Yang, Helin
    Zhao, Jun
    Nie, Jiangtian
    Kumar, Neeraj
    Lam, Kwok-Yan
    Xiong, Zehui
    IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (IEEE INFOCOM WKSHPS 2021), 2021,
  • [45] Joint QoS and energy-efficient resource allocation and scheduling in 5G Network Slicing
    Saibharath, S.
    Mishra, Sudeepta
    Hota, Chittaranjan
    COMPUTER COMMUNICATIONS, 2023, 202 : 110 - 123
  • [46] Auction-based network slicing for 5G RAN
    Zorello, Ligia M. Moreira
    Eradatmand, Kazem
    Troia, Sebastian
    Pattavina, Achille
    Zhang, Yingqian
    Maier, Guido
    2023 IEEE 9TH INTERNATIONAL CONFERENCE ON NETWORK SOFTWARIZATION, NETSOFT, 2023, : 390 - 395
  • [47] Joint Baseband and Radio Resource Allocation for 5G Network Slicing in H-CRANs
    Xing, Chen
    Lee, Ying Loong
    Chang, Yoong Choon
    2022 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2022, : 891 - 896
  • [48] Applications of Machine Learning in Resource Management for RAN-Slicing in 5G and Beyond Networks: A Survey
    Azimi, Yaser
    Yousefi, Saleh
    Kalbkhani, Hashem
    Kunz, Thomas
    IEEE ACCESS, 2022, 10 : 106581 - 106612
  • [49] RAN Resource Slicing in 5G Using Multi-Agent Correlated Q-Learning
    Zhou, Hao
    Elsayed, Medhat
    Erol-Kantarci, Melike
    2021 IEEE 32ND ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (PIMRC), 2021,
  • [50] Radio Resource Allocation for 5G Networks Using Deep Reinforcement Learning
    Munaye, Yirga Yayeh
    Lin, Hsin-Piao
    Lin, Ding-Bing
    Juang, Rong-Terng
    Tarekegn, Getaneh Berie
    Jeng, Shiann-Shiun
    2021 30TH WIRELESS AND OPTICAL COMMUNICATIONS CONFERENCE (WOCC 2021), 2021, : 66 - 69