Robust Deep Reinforcement Learning Algorithm for VNF-FG Embedding

被引:4
|
作者
Bouroudi, Abdelmounaim [1 ]
Outtagarts, Abdelkader [1 ]
Hadjadj-Aoul, Yassine [2 ]
机构
[1] Nokia Bell Labs, Nokia Paris Saclay, Nozay, France
[2] Univ Rennes, INRIA, CNRS, IRISA, Rennes, France
关键词
Virtual Network Embedding; Reinforcement Learning; Algorithm Selection; B5G/6G;
D O I
10.1109/LCN53696.2022.9843650
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Network slicing, also known as the virtual network embedding (VNE) problem, is an NPhard optimization problem. Compared to traditional approaches, the methods relying on deep reinforcement learning yield better performance without exhibiting issues such as stacking at local minima and/or solutions' space exploration limits. These algorithms present, however, different performances according to the employed approach, and the problem to be treated, resulting in robustness problems. To overcome these limits, we propose the adoption of the best algorithm, from a selection of learning strategies, in terms of reward and sample efficiency at each time step. The proposed strategy acts as a meta-algorithm that brings more robustness to the network by dynamically selecting the best solution for a specific scenario. Our solution proved its efficiency and managed to dynamically select the best algorithm in terms of the best acceptance ratio of the deployed services and outperform all the stand-alone algorithms.
引用
收藏
页码:351 / 354
页数:4
相关论文
共 50 条
  • [1] A Green VNF-FG Embedding Algorithm
    Soualah, Oussama
    Mechtri, Marouen
    Ghribi, Chaima
    Zeghlache, Djamal
    [J]. 2018 4TH IEEE CONFERENCE ON NETWORK SOFTWARIZATION AND WORKSHOPS (NETSOFT), 2018, : 141 - 149
  • [2] Energy Efficient VNF-FG Embedding via Attention-based Deep Reinforcement Learning
    Houidi, Omar
    Soualah, Oussama
    Houidi, Ines
    Zeghlache, Djamal
    [J]. 2023 19TH INTERNATIONAL CONFERENCE ON NETWORK AND SERVICE MANAGEMENT, CNSM, 2023,
  • [3] Multi-domain non-cooperative VNF-FG embedding: A deep reinforcement learning approach
    Pham Tran Anh Quang
    Bradai, Abbas
    Singh, Kamal Deep
    Hadjadj-Aoul, Yassine
    [J]. IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (IEEE INFOCOM 2019 WKSHPS), 2019, : 886 - 891
  • [4] Energy-Aware VNF-FG Placement with Transformer-based Deep Reinforcement Learning
    Sahraoui, Rania
    Houidi, Omar
    Bannour, Fetia
    [J]. PROCEEDINGS OF 2024 IEEE/IFIP NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM, NOMS 2024, 2024,
  • [5] h-Horizon Sequential Look-ahead Greedy Algorithm for VNF-FG Embedding
    Ebrahimzadeh, Amin
    Promwongsa, Nattakorn
    Afrasiabi, Seyedeh Negar
    Mouradian, Carla
    Li, Wubin
    Recse, Akos
    Szabo, Robert
    Glitho, Roch H.
    [J]. 2021 IEEE CONFERENCE ON NETWORK FUNCTION VIRTUALIZATION AND SOFTWARE DEFINED NETWORKS (IEEE NFV-SDN), 2021, : 41 - 46
  • [6] Hierarchical Multi-Agent Deep Reinforcement Learning with an Attention-based Graph Matching Approach for Multi-Domain VNF-FG Embedding
    Slim, Lotfi
    Bannour, Fetia
    [J]. IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 2105 - 2110
  • [7] Evolutionary Actor-Multi-Critic Model for VNF-FG Embedding
    Pham Tran Anh Quang
    Hadjadj-Aoul, Yassine
    Outtagarts, Abdelkader
    [J]. 2020 IEEE 17TH ANNUAL CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE (CCNC 2020), 2020,
  • [8] On Efficient VNF-FG Design in IoT Networks
    Ren, Cheng
    Zhang, Jiangping
    Wang, Yu
    Li, Yaxin
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2024, 21 (04): : 4531 - 4542
  • [9] A Deep Reinforcement Learning Approach for VNF Forwarding Graph Embedding
    Pham Tran Anh Quang
    Hadjadj-Aoul, Yassine
    Outtagarts, Abdelkader
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2019, 16 (04): : 1318 - 1331
  • [10] Look-Ahead VNF-FG Embedding Framework for Latency-Sensitive Network Services
    Recse, Akos
    Promwongsa, Nattakorn
    Ebrahimzadeh, Amin
    Afrasiabi, Seyedeh Negar
    Mouradian, Carla
    Li, Wubin
    Szabo, Robert
    Glitho, Roch H.
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2023, 20 (03): : 2682 - 2697