Safe and Fast Reinforcement Learning for Network Slicing Resource Allocation

被引:0
|
作者
Massaro, Antonio [1 ]
Wellington, Dan [3 ]
Aghasaryan, Armen [1 ]
Seidl, Robert [2 ]
Naseer-Ul-Islam, Muhammad [2 ]
Bulakci, Oemer [2 ]
机构
[1] Nokia Bell Labs, Paris, France
[2] Nokia Bell Labs, Munich, Germany
[3] Nokia Bell Labs, Murray Hill, NJ USA
关键词
D O I
10.1109/VTC2023-Spring57618.2023.10199857
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Network slicing enables operators to virtually partition network resources and instantiate different virtual networks, supporting flexible quality of service, in the form of service level agreements (SLAs). Optimizing resource allocation for network slicing is a complex task, given the dynamicity and randomness of network conditions. Leveraging principles of reinforcement learning, we propose an algorithmic solution to optimize the SLA success rate across a radio access network. Tailoring the algorithm to the problem at hand, and leveraging some prior knowledge on the system to be optimized, we ensure fast convergence, data efficiency, and safe exploration. The solution is scalable both in the number of cells and in the number of slices. Extensive numerical evaluations on a simulated environment show the effectiveness of the proposed solution and its advantages versus both simple baselines and sophisticated solutions based on deep reinforcement learning, in terms of speed of convergence and SLA success rate.
引用
收藏
页数:7
相关论文
共 50 条
  • [41] Distributed Resource Allocation for Network Slicing of Bandwidth and Computational Resource
    Huang, Anqi
    Li, Yingyu
    Xiao, Yong
    Ge, Xiaohu
    Sun, Sumei
    Chao, Han-Chieh
    [J]. ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
  • [42] Resource Allocation in Data Centers Using Fast Reinforcement Learning Algorithms
    Jiang, Yuang
    Kodialam, Murali
    Lakshman, T., V
    Mukherjee, Sarit
    Tassiulas, Leandros
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2021, 18 (04): : 4576 - 4588
  • [43] Digital-Twin-Assisted Resource Allocation for Network Slicing in Industry 4.0 and Beyond Using Distributed Deep Reinforcement Learning
    Tang, Lun
    Du, Yucong
    Liu, Qinghai
    Li, Jinyu
    Li, Shirui
    Chen, Qianbin
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (19) : 16989 - 17006
  • [44] Resource Allocation for Cognitive Network Slicing in PD-SCMA System Based on Two-Way Deep Reinforcement Learning
    Zhang, Zhenyu
    Zhang, Yong
    Yuan, Siyu
    Cheng, Zhenjie
    [J]. CHINA COMMUNICATIONS, 2022, 21 (06) : 53 - 68
  • [45] Intelligent Resource Allocation Algorithm for 6G Multi-tenant Network Slicing Based on Deep Reinforcement Learning
    Guan, Wan-Qing
    Zhang, Hai-Jun
    Lu, Zhao-Ming
    [J]. Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2020, 43 (06): : 132 - 139
  • [46] Resource Allocation for Cognitive Network Slicing in PD-SCMA System Based on Two-Way Deep Reinforcement Learning
    Zhang Zhenyu
    Zhang Yong
    Yuan Siyu
    Cheng Zhenjie
    [J]. China Communications, 2024, 21 (06) : 53 - 68
  • [47] GAN-based Deep Distributional Reinforcement Learning for Resource Management in Network Slicing
    Hua, Yuxiu
    Li, Rongpeng
    Zhao, Zhifeng
    Zhang, Honggang
    Chen, Xianfu
    [J]. 2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [48] GAN-Powered Deep Distributional Reinforcement Learning for Resource Management in Network Slicing
    Hua, Yuxiu
    Li, Rongpeng
    Zhao, Zhifeng
    Chen, Xianfu
    Zhang, Honggang
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2020, 38 (02) : 334 - 349
  • [49] Deep Reinforcement Learning With Discrete Normalized Advantage Functions for Resource Management in Network Slicing
    Qi, Chen
    Hua, Yuxiu
    Li, Rongpeng
    Zhao, Zhifeng
    Zhang, Honggang
    [J]. IEEE COMMUNICATIONS LETTERS, 2019, 23 (08) : 1337 - 1341
  • [50] Resource Allocation for Network Slicing in WiFi Access Points
    Richart, Matias
    Baliosian, Javier
    Serrat, Joan
    Gorricho, Juan-Luis
    Aguero, Ramon
    Agoulmine, Nazim
    [J]. 2017 13TH INTERNATIONAL CONFERENCE ON NETWORK AND SERVICE MANAGEMENT (CNSM), 2017,