Multi-domain non-cooperative VNF-FG embedding: A deep reinforcement learning approach

被引:0
|
作者
Pham Tran Anh Quang [1 ]
Bradai, Abbas [2 ]
Singh, Kamal Deep [3 ]
Hadjadj-Aoul, Yassine [1 ]
机构
[1] Univ Rennes, CNRS, IRISA, INRIA, Rennes, France
[2] Univ Poitiers, XLIM, Poitiers, France
[3] Univ St Etienne, Lab Hubert Curien, St Etienne, France
关键词
D O I
10.1109/infcomw.2019.8845184
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Network Function Virtualization (NFV) and service orchestration simplify the deployment and management of network and telecommunication services. The deployment of these services require, typically, the allocation of Virtual Network Function - Forwarding Graph (VNF-FG), which implies not only the fulfillment of the service's requirements in terms of Quality of Service (QoS), but also considering the constraints of the underlying infrastructure. This topic has been well-studied in existing literature, however, its complexity and uncertainty unveil many challenges for researchers and engineers. This issue is especially complex when it comes to placing a service on several non-cooperative domains, where the network operators hide their infrastructure to other competing domains. In this paper, we address these problems by proposing a deep reinforcement learning based VNF-FG embedding approach. The results provide insights into behaviors of non-cooperative domains. They also show the efficiency of proposed VNF-FG deployment approach having automatic inter-domain load balancing.
引用
收藏
页码:886 / 891
页数:6
相关论文
共 50 条
  • [1] Hierarchical Multi-Agent Deep Reinforcement Learning with an Attention-based Graph Matching Approach for Multi-Domain VNF-FG Embedding
    Slim, Lotfi
    Bannour, Fetia
    [J]. IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 2105 - 2110
  • [2] Robust Deep Reinforcement Learning Algorithm for VNF-FG Embedding
    Bouroudi, Abdelmounaim
    Outtagarts, Abdelkader
    Hadjadj-Aoul, Yassine
    [J]. PROCEEDINGS OF THE 2022 47TH IEEE CONFERENCE ON LOCAL COMPUTER NETWORKS (LCN 2022), 2022, : 351 - 354
  • [3] Energy Efficient VNF-FG Embedding via Attention-based Deep Reinforcement Learning
    Houidi, Omar
    Soualah, Oussama
    Houidi, Ines
    Zeghlache, Djamal
    [J]. 2023 19TH INTERNATIONAL CONFERENCE ON NETWORK AND SERVICE MANAGEMENT, CNSM, 2023,
  • [4] Evolutionary Actor-Multi-Critic Model for VNF-FG Embedding
    Pham Tran Anh Quang
    Hadjadj-Aoul, Yassine
    Outtagarts, Abdelkader
    [J]. 2020 IEEE 17TH ANNUAL CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE (CCNC 2020), 2020,
  • [5] Energy-Aware VNF-FG Placement with Transformer-based Deep Reinforcement Learning
    Sahraoui, Rania
    Houidi, Omar
    Bannour, Fetia
    [J]. PROCEEDINGS OF 2024 IEEE/IFIP NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM, NOMS 2024, 2024,
  • [6] A Deep Reinforcement Learning Approach for VNF Forwarding Graph Embedding
    Pham Tran Anh Quang
    Hadjadj-Aoul, Yassine
    Outtagarts, Abdelkader
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2019, 16 (04): : 1318 - 1331
  • [7] Non-Cooperative Inverse Reinforcement Learning
    Zhang, Xiangyuan
    Zhang, Kaiqing
    Miehling, Erik
    Basar, Tamer
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [8] On using Deep Reinforcement Learning for Multi-Domain SFC placement
    Toumi, Nassima
    Bagaa, Miloud
    Ksentini, Adlen
    [J]. 2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [9] Multi-agent Deep Reinforcement Learning for Non-Cooperative Power Control in Heterogeneous Networks
    Zhang, Lin
    Liang, Ying-Chang
    [J]. 2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [10] Single and Multi-Domain Adaptive Allocation Algorithms for VNF Forwarding Graph Embedding
    Pham Tran Anh Quang
    Bradai, Abbas
    Singh, Kamal Deep
    Picard, Gauthier
    Riggio, Roberto
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2019, 16 (01): : 98 - 112