Safe and Fast Reinforcement Learning for Network Slicing Resource Allocation

被引:0
|
作者
Massaro, Antonio [1 ]
Wellington, Dan [3 ]
Aghasaryan, Armen [1 ]
Seidl, Robert [2 ]
Naseer-Ul-Islam, Muhammad [2 ]
Bulakci, Oemer [2 ]
机构
[1] Nokia Bell Labs, Paris, France
[2] Nokia Bell Labs, Munich, Germany
[3] Nokia Bell Labs, Murray Hill, NJ USA
关键词
D O I
10.1109/VTC2023-Spring57618.2023.10199857
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Network slicing enables operators to virtually partition network resources and instantiate different virtual networks, supporting flexible quality of service, in the form of service level agreements (SLAs). Optimizing resource allocation for network slicing is a complex task, given the dynamicity and randomness of network conditions. Leveraging principles of reinforcement learning, we propose an algorithmic solution to optimize the SLA success rate across a radio access network. Tailoring the algorithm to the problem at hand, and leveraging some prior knowledge on the system to be optimized, we ensure fast convergence, data efficiency, and safe exploration. The solution is scalable both in the number of cells and in the number of slices. Extensive numerical evaluations on a simulated environment show the effectiveness of the proposed solution and its advantages versus both simple baselines and sophisticated solutions based on deep reinforcement learning, in terms of speed of convergence and SLA success rate.
引用
收藏
页数:7
相关论文
共 50 条
  • [21] Graph convolutional reinforcement learning for resource allocation in hybrid overlay-underlay cognitive radio network with network slicing
    Yuan, Siyu
    Zhang, Yong
    Ma, Tengteng
    Cheng, Zhenjie
    Guo, Da
    [J]. IET COMMUNICATIONS, 2023, 17 (02) : 215 - 227
  • [22] Slicing the Edge: Resource Allocation for RAN Network Slicing
    Phuong Luu Vo
    Minh N H Nguyen
    Nan Anh Le
    Nguyen H Tran
    [J]. IEEE WIRELESS COMMUNICATIONS LETTERS, 2018, 7 (06) : 970 - 973
  • [23] Multi-Agent Reinforcement Learning for Slicing Resource Allocation in Vehicular Networks
    Cui, Yaping
    Shi, Hongji
    Wang, Ruyan
    He, Peng
    Wu, Dapeng
    Huang, Xinyun
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (02) : 2005 - 2016
  • [24] Federated Deep Reinforcement Learning for Resource Allocation in O-RAN Slicing
    Zhang, Han
    Zhou, Hao
    Erol-Kantarci, Melike
    [J]. 2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 958 - 963
  • [25] A Resource Allocation Framework for Network Slicing
    Leconte, Mathieu
    Paschos, Georgios S.
    Mertikopoulos, Panayotis
    Kozat, Ulas C.
    [J]. IEEE CONFERENCE ON COMPUTER COMMUNICATIONS (IEEE INFOCOM 2018), 2018, : 2177 - 2185
  • [26] Flexible Resource Block Allocation to Multiple Slices for Radio Access Network Slicing Using Deep Reinforcement Learning
    Abiko, Yu
    Saito, Takato
    Ikeda, Daizo
    Ohta, Ken
    Mizuno, Tadanori
    Mineno, Hiroshi
    [J]. IEEE ACCESS, 2020, 8 : 68183 - 68198
  • [27] Intimacy-based Resource Allocation for Network Slicing in 5G via Deep Reinforcement Learning
    He, Nan
    Yang, Song
    Li, Fan
    Chen, Xu
    [J]. IEEE NETWORK, 2021, 35 (06): : 111 - 118
  • [28] Reinforcement-Learning-Based Network Slicing and Resource Allocation for Multi-Access Edge Computing Networks
    Jiang, Shurui
    Zheng, Jun
    Yan, Feng
    Zhao, Shuyuan
    [J]. IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2024, 10 (03) : 1132 - 1145
  • [29] Using Distributed Reinforcement Learning for Resource Orchestration in a Network Slicing Scenario
    Mason, Federico
    Nencioni, Gianfranco
    Zanella, Andrea
    [J]. IEEE-ACM TRANSACTIONS ON NETWORKING, 2023, 31 (01) : 88 - 102
  • [30] Reinforcement Learning for Resource Mapping in 5G Network Slicing
    Zhao, Liyuan
    Li, Li
    [J]. 2020 5TH INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATION SYSTEMS (ICCCS 2020), 2020, : 869 - 873