A Reinforcement Learning-Based Routing Strategy for Elastic Network Slices

被引:1
|
作者
Wu, Zhouxiang [1 ,2 ]
Jue, Jason P. [1 ,2 ]
机构
[1] Univ Texas, Dept Comp Sci, Dallas, TX 75080 USA
[2] Univ Texas, Dept Comp Sci, Dallas, TX 75080 USA
基金
美国国家科学基金会;
关键词
network slice; reinforcement learning; routing; policy gradient;
D O I
10.1109/ICC45855.2022.9838531
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
This paper addresses a routing selection strategy for elastic network slices that dynamically adjust required resources over time. When admitting elastic initial slice requests, sufficient spare resources on the same path should be reserved to allow existing elastic slices to increase their bandwidth dynamically. We demonstrate a deep Reinforcement Learning (RL) model to intelligently make routing choice decisions for elastic slice requests and inelastic slice requests. This model achieves higher revenue and higher acceptance rates compared to traditional heuristic methods. Due to the lightness of this model, it can be deployed in an embedded system. We can also use a relatively small amount of data to train the model and achieve stable performance. Also, we introduce a Recurrent Neural Network to auto-encode the variable-size environment and train the encoder together with the RL model.
引用
收藏
页码:5505 / 5510
页数:6
相关论文
共 50 条
  • [1] A Reinforcement Learning-Based Admission Control Strategy for Elastic Network Slices
    Wu, Zhouxiang
    Ishigaki, Genya
    Gour, Riti
    Jue, Jason P.
    [J]. 2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [2] ICN routing strategy based on reinforcement learning and neural network
    Li, Huizhu
    [J]. INTERNET TECHNOLOGY LETTERS, 2021, 4 (05)
  • [3] A Reinforcement Learning-Based Routing Protocol in VANETs
    Sun, Yanglong
    Lin, Yiming
    Tang, Yuliang
    [J]. COMMUNICATIONS, SIGNAL PROCESSING, AND SYSTEMS, 2019, 463 : 2493 - 2500
  • [4] A multiple neural network and reinforcement learning-based strategy for process control
    Dutta, Debaprasad
    Upreti, Simant R.
    [J]. JOURNAL OF PROCESS CONTROL, 2023, 121 : 103 - 118
  • [5] A reinforcement learning-based routing for delay tolerant networks
    Rolla, Vitor G.
    Curado, Marilia
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2013, 26 (10) : 2243 - 2250
  • [6] Reinforcement Learning-Based Routing Protocol for Opportunistic Networks
    Dhurandher, Sanjay Kumar
    Singh, Jagdeep
    Obaidat, Mohammad S.
    Woungang, Isaac
    Srivastava, Samariddhi
    Rodrigues, Joel J. P. C.
    [J]. ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
  • [7] Reinforcement learning-based load shared sequential routing
    Heidari, Fariba
    Manner, Shie
    Mason, Lorne G.
    [J]. NETWORKING 2007: AD HOC AND SENSOR NETWORKS, WIRELESS NETWORKS, NEXT GENERATION INTERNET, PROCEEDINGS, 2007, 4479 : 832 - +
  • [8] Cost-efficient Federated Reinforcement Learning-Based Network Routing for Wireless Networks
    Abou El Houda, Zakaria
    Nabousli, Diala
    Kaddoum, Georges
    [J]. 2022 IEEE FUTURE NETWORKS WORLD FORUM, FNWF, 2022, : 243 - 248
  • [9] DRLAR: A deep reinforcement learning-based adaptive routing framework for network-on-chips
    Wang, Shaocong
    Zhang, Xiaoyun
    Wang, Changhong
    Wu, Ke
    Li, Cunlu
    Dong, Dezun
    [J]. COMPUTER NETWORKS, 2024, 246
  • [10] Reinforcement Learning for Routing Strategy Considering the State of Network Link
    Hu, Zhaohui
    [J]. ADVANCES IN MANUFACTURING TECHNOLOGY, PTS 1-4, 2012, 220-223 : 2772 - 2776