Safe and Fast Reinforcement Learning for Network Slicing Resource Allocation

被引:0
|
作者
Massaro, Antonio [1 ]
Wellington, Dan [3 ]
Aghasaryan, Armen [1 ]
Seidl, Robert [2 ]
Naseer-Ul-Islam, Muhammad [2 ]
Bulakci, Oemer [2 ]
机构
[1] Nokia Bell Labs, Paris, France
[2] Nokia Bell Labs, Munich, Germany
[3] Nokia Bell Labs, Murray Hill, NJ USA
关键词
D O I
10.1109/VTC2023-Spring57618.2023.10199857
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Network slicing enables operators to virtually partition network resources and instantiate different virtual networks, supporting flexible quality of service, in the form of service level agreements (SLAs). Optimizing resource allocation for network slicing is a complex task, given the dynamicity and randomness of network conditions. Leveraging principles of reinforcement learning, we propose an algorithmic solution to optimize the SLA success rate across a radio access network. Tailoring the algorithm to the problem at hand, and leveraging some prior knowledge on the system to be optimized, we ensure fast convergence, data efficiency, and safe exploration. The solution is scalable both in the number of cells and in the number of slices. Extensive numerical evaluations on a simulated environment show the effectiveness of the proposed solution and its advantages versus both simple baselines and sophisticated solutions based on deep reinforcement learning, in terms of speed of convergence and SLA success rate.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] Constrained Reinforcement Learning for Resource Allocation in Network Slicing
    Xu, Yizhen
    Zhao, Zhengyang
    Cheng, Peng
    Chen, Zhuo
    Ding, Ming
    Vucetic, Branka
    Li, Yonghui
    [J]. IEEE COMMUNICATIONS LETTERS, 2021, 25 (05) : 1554 - 1558
  • [2] Dynamic Resource Allocation in Network Slicing with Deep Reinforcement Learning
    Cai, Yue
    Cheng, Peng
    Chen, Zhuo
    Xiang, Wei
    Vucetic, Branka
    Li, Yonghui
    [J]. IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 2955 - 2960
  • [3] Deep Reinforcement Learning for Online Resource Allocation in Network Slicing
    Cai, Yue
    Cheng, Peng
    Chen, Zhuo
    Ding, Ming
    Vucetic, Branka
    Li, Yonghui
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (06) : 7099 - 7116
  • [4] Deep Reinforcement Learning for Resource Allocation with Network Slicing in Cognitive Radio Network*
    Yuan, Siyu
    Zhang, Yong
    Qie, Wenbo
    Ma, Tengteng
    Li, Sisi
    [J]. COMPUTER SCIENCE AND INFORMATION SYSTEMS, 2021, 18 (03) : 979 - 999
  • [5] Resource Allocation Method for Network Slicing Using Constrained Reinforcement Learning
    Liu, Yongshuai
    Ding, Jiaxin
    Liu, Xin
    [J]. 2021 IFIP NETWORKING CONFERENCE AND WORKSHOPS (IFIP NETWORKING), 2021,
  • [6] DeepSlicing: Deep Reinforcement Learning Assisted Resource Allocation for Network Slicing
    Liu, Qiang
    Han, Tao
    Zhang, Ning
    Wang, Ye
    [J]. 2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [7] CLARA: A Constrained Reinforcement Learning Based Resource Allocation Framework for Network Slicing
    Liu, Yongshuai
    Ding, Jiaxin
    Zhang, Zhi-Li
    Liu, Xin
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2021, : 1427 - 1437
  • [8] Deep Reinforcement Learning Based Resource Allocation for Network Slicing With Massive MIMO
    Yan, Dandan
    Ng, Benjamin K.
    Ke, Wei
    Lam, Chan-Tong
    [J]. IEEE ACCESS, 2023, 11 : 75899 - 75911
  • [9] Radio Resource Allocation Method for Network Slicing using Deep Reinforcement Learning
    Abiko, Yu
    Saito, Takato
    Ikeda, Daizo
    Ohta, Ken
    Mizuno, Tadanori
    Mineno, Hiroshi
    [J]. 2020 34TH INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING (ICOIN 2020), 2020, : 420 - 425
  • [10] Hierarchical Reinforcement Learning Based Resource Allocation for RAN Slicing
    Anil Akyildiz, Hasan
    Faruk Gemici, Omer
    Hokelek, Ibrahim
    Ali Cirpan, Hakan
    [J]. IEEE ACCESS, 2024, 12 : 75818 - 75831