Robust Deep Reinforcement Learning Algorithm for VNF-FG Embedding

被引:4
|
作者
Bouroudi, Abdelmounaim [1 ]
Outtagarts, Abdelkader [1 ]
Hadjadj-Aoul, Yassine [2 ]
机构
[1] Nokia Bell Labs, Nokia Paris Saclay, Nozay, France
[2] Univ Rennes, INRIA, CNRS, IRISA, Rennes, France
关键词
Virtual Network Embedding; Reinforcement Learning; Algorithm Selection; B5G/6G;
D O I
10.1109/LCN53696.2022.9843650
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Network slicing, also known as the virtual network embedding (VNE) problem, is an NPhard optimization problem. Compared to traditional approaches, the methods relying on deep reinforcement learning yield better performance without exhibiting issues such as stacking at local minima and/or solutions' space exploration limits. These algorithms present, however, different performances according to the employed approach, and the problem to be treated, resulting in robustness problems. To overcome these limits, we propose the adoption of the best algorithm, from a selection of learning strategies, in terms of reward and sample efficiency at each time step. The proposed strategy acts as a meta-algorithm that brings more robustness to the network by dynamically selecting the best solution for a specific scenario. Our solution proved its efficiency and managed to dynamically select the best algorithm in terms of the best acceptance ratio of the deployed services and outperform all the stand-alone algorithms.
引用
收藏
页码:351 / 354
页数:4
相关论文
共 50 条
  • [31] Adversary Agnostic Robust Deep Reinforcement Learning
    Qu, Xinghua
    Gupta, Abhishek
    Ong, Yew-Soon
    Sun, Zhu
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (09) : 6146 - 6157
  • [32] Robust Deep Reinforcement Learning for Quadcopter Control
    Deshpande, Aditya M.
    Minai, Ali A.
    Kumar, Manish
    [J]. IFAC PAPERSONLINE, 2021, 54 (20): : 90 - 95
  • [33] SFC Embedding Meets Machine Learning: Deep Reinforcement Learning Approaches
    Liu, Yicen
    Lu, Yu
    Li, Xi
    Qiao, Wenxin
    Li, Zhiwei
    Zhao, Donghao
    [J]. IEEE COMMUNICATIONS LETTERS, 2021, 25 (06) : 1926 - 1930
  • [34] Deep Reinforcement Learning based VNF Management in Geo-distributed Edge Computing
    Gu, Lin
    Zeng, Deze
    Li, Wei
    Guo, Song
    Zomaya, Albert Y.
    Jin, Hai
    [J]. 2019 39TH IEEE INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS 2019), 2019, : 934 - 943
  • [35] VNF Placement over Autonomic Elastic Optical Network via Deep Reinforcement Learning
    Hernandez-Chulde, Carlos
    Casellas, Ramon
    Martinez, Ricardo
    Vilalta, Ricard
    Munoz, Raul
    [J]. ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 422 - 427
  • [36] Age of Information Aware VNF Scheduling in Industrial IoT Using Deep Reinforcement Learning
    Akbari, Mohammad
    Abedi, Mohammad Reza
    Joda, Roghayeh
    Pourghasemian, Mohsen
    Mokari, Nader
    Erol-Kantarci, Melike
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (08) : 2487 - 2500
  • [37] Energy-Efficient and Interference-Aware VNF Placement with Deep Reinforcement Learning
    Mu, Yanyan
    Wang, Lei
    Zhao, Jin
    [J]. 2021 IFIP NETWORKING CONFERENCE AND WORKSHOPS (IFIP NETWORKING), 2021,
  • [38] Deep Reinforcement Learning for Topology-Aware VNF Resource Prediction in NFV Environments
    Jalodia, Nikita
    Henna, Shagufta
    Davy, Alan
    [J]. 2019 IEEE CONFERENCE ON NETWORK FUNCTION VIRTUALIZATION AND SOFTWARE DEFINED NETWORKS (IEEE NFV-SDN), 2019,
  • [39] Deep Reinforcement Learning for Demand-Aware Joint VNF Placement-and-Routing
    Wang, Shaoyang
    Lv, Tiejun
    [J]. 2019 IEEE GLOBECOM WORKSHOPS (GC WKSHPS), 2019,
  • [40] Online Fault-tolerant VNF Chain Placement: A Deep Reinforcement Learning Approach
    Mao, Weixi
    Wang, Lei
    Zhao, Jin
    Xu, Yuedong
    [J]. 2020 IFIP NETWORKING CONFERENCE AND WORKSHOPS (NETWORKING), 2020, : 163 - 171