Resource Allocation Method for Network Slicing Using Constrained Reinforcement Learning

被引:5
|
作者
Liu, Yongshuai [1 ]
Ding, Jiaxin [2 ]
Liu, Xin [1 ]
机构
[1] Univ Calif Davis, Dept Comp Sci, Davis, CA 95616 USA
[2] Shanghai Jiao Tong Univ, John Hopcroft Ctr Comp Sci, Shanghai, Peoples R China
关键词
Resource Allocation; Network Slicing; 5G; Constraints; Deep Reinforcement Learning;
D O I
10.23919/IFIPNETWORKING52078.2021.9472202
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With the proliferation of mobile networks, we face strong diversification of services, demanding the network to be more flexible. To satisfy this dire need, network slicing is embraced as a promising solution for resource utilization in 5G and future networks. However, this process is complicated that the traditional approaches cannot effectively perform resource orchestration due to the lack of accurate models and the existence of dynamic hidden structures. We formulate the resource allocation problem as a Constrained Markov Decision Process and solve it using constrained reinforcement learning. Specifically, we use the adaptive interior-point policy optimization and projection layers to handle cumulative and instantaneous constraints. Our evaluations show that our method is effective in resource allocation and outperforms baselines.
引用
收藏
页数:3
相关论文
共 50 条
  • [1] Constrained Reinforcement Learning for Resource Allocation in Network Slicing
    Xu, Yizhen
    Zhao, Zhengyang
    Cheng, Peng
    Chen, Zhuo
    Ding, Ming
    Vucetic, Branka
    Li, Yonghui
    [J]. IEEE COMMUNICATIONS LETTERS, 2021, 25 (05) : 1554 - 1558
  • [2] Radio Resource Allocation Method for Network Slicing using Deep Reinforcement Learning
    Abiko, Yu
    Saito, Takato
    Ikeda, Daizo
    Ohta, Ken
    Mizuno, Tadanori
    Mineno, Hiroshi
    [J]. 2020 34TH INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING (ICOIN 2020), 2020, : 420 - 425
  • [3] CLARA: A Constrained Reinforcement Learning Based Resource Allocation Framework for Network Slicing
    Liu, Yongshuai
    Ding, Jiaxin
    Zhang, Zhi-Li
    Liu, Xin
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2021, : 1427 - 1437
  • [4] Dynamic Resource Allocation in Network Slicing with Deep Reinforcement Learning
    Cai, Yue
    Cheng, Peng
    Chen, Zhuo
    Xiang, Wei
    Vucetic, Branka
    Li, Yonghui
    [J]. IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 2955 - 2960
  • [5] Deep Reinforcement Learning for Online Resource Allocation in Network Slicing
    Cai, Yue
    Cheng, Peng
    Chen, Zhuo
    Ding, Ming
    Vucetic, Branka
    Li, Yonghui
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (06) : 7099 - 7116
  • [6] Safe and Fast Reinforcement Learning for Network Slicing Resource Allocation
    Massaro, Antonio
    Wellington, Dan
    Aghasaryan, Armen
    Seidl, Robert
    Naseer-Ul-Islam, Muhammad
    Bulakci, Oemer
    [J]. 2023 IEEE 97TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2023-SPRING, 2023,
  • [7] Deep Reinforcement Learning for Resource Allocation with Network Slicing in Cognitive Radio Network*
    Yuan, Siyu
    Zhang, Yong
    Qie, Wenbo
    Ma, Tengteng
    Li, Sisi
    [J]. COMPUTER SCIENCE AND INFORMATION SYSTEMS, 2021, 18 (03) : 979 - 999
  • [8] DeepSlicing: Deep Reinforcement Learning Assisted Resource Allocation for Network Slicing
    Liu, Qiang
    Han, Tao
    Zhang, Ning
    Wang, Ye
    [J]. 2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [9] Deep Reinforcement Learning Based Resource Allocation for Network Slicing With Massive MIMO
    Yan, Dandan
    Ng, Benjamin K.
    Ke, Wei
    Lam, Chan-Tong
    [J]. IEEE ACCESS, 2023, 11 : 75899 - 75911
  • [10] A Constrained Reinforcement Learning Based Approach for Network Slicing
    Liu, Yongshuai
    Ding, Jiaxin
    Liu, Xin
    [J]. 2020 IEEE 28TH INTERNATIONAL CONFERENCE ON NETWORK PROTOCOLS (IEEE ICNP 2020), 2020,