Reliability-aware Dynamic Service Chain Scheduling in 5G Networks based on Reinforcement Learning

被引:23
|
作者
Jia, Junzhong [1 ]
Yang, Lei [1 ]
Cao, Jiannong [2 ]
机构
[1] South China Univ Technol, Sch Software Engn, Guangzhou, Peoples R China
[2] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Service function chain; SG network; reliability; reinforcement learning; NFV;
D O I
10.1109/INFOCOM42981.2021.9488707
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
As a key enabler of future SG network, Service Function Chain (SFC) forwards the traffic flow along a chain of Virtual Network Functions (VNFs) to provide network services flexibility. One of the most important problems in SFC is to deploy the VNFs and schedule arriving requests among computing nodes to achieve low latency and high reliability. Existing works consider a static network and assume that all SFC requests are known in advance, which is impractical. In this paper, we focus on the dynamic SG network environment where the SFC requests arrive randomly and the computing nodes can redeploy all types of VNF with a time cost. We formulate the problem of SFC scheduling in NFV-enabled SG network as a mixed integer non-linear programing. The objective is to maximize the number of requests satisfying the latency and reliability constraints. To solve the problem, we propose an efficient algorithm to decide the redundancy of the VNFs while minimizing delay. Then we present a state-of-art Reinforcement Learning (RL) to learn SFC scheduling policy to increase the success rate of SFC requests. The effectiveness of our method is evaluated through extensive simulations. The result shows that our proposed RL solution can increase the success rate by 18.7% over the benchmarks.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Reliable Dynamic Service Chain Scheduling in 5G Networks
    Yang, Lei
    Jia, Junzhong
    Lin, Hongcai
    Cao, Jiannong
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (08) : 4898 - 4911
  • [2] Reinforcement learning based reliability-aware routing in IoT networks
    Ergun, Kazim
    Ayoub, Raid
    Mercati, Pietro
    Rosing, Tajana
    [J]. AD HOC NETWORKS, 2022, 132
  • [3] Reliability-aware intelligent mapping based on reinforcement learning for networks-on-chips
    Kadri, Nassima
    Chenine, Azzeddine
    Laib, Zakaria
    Koudil, Mouloud
    [J]. JOURNAL OF SUPERCOMPUTING, 2022, 78 (16): : 18153 - 18188
  • [4] Reliability-aware intelligent mapping based on reinforcement learning for networks-on-chips
    Nassima Kadri
    Azzeddine Chenine
    Zakaria Laib
    Mouloud Koudil
    [J]. The Journal of Supercomputing, 2022, 78 : 18153 - 18188
  • [5] A Reliability-Aware, Delay Guaranteed, and Resource Efficient Placement of Service Function Chains in Softwarized 5G Networks
    Thiruvasagam, Prabhu Kaliyammal
    Kotagi, Vijeth J.
    Murthy, C. Siva Ram
    [J]. IEEE TRANSACTIONS ON CLOUD COMPUTING, 2022, 10 (03) : 1515 - 1531
  • [6] Dynamic Resource Aware VNF Placement with Deep Reinforcement Learning for 5G Networks
    Dalgkitsis, Anestis
    Mekikis, Prodromos-Vasileios
    Antonopoulos, Angelos
    Kormentzas, Georgios
    Verikoukis, Christos
    [J]. 2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [7] VNF Service Chain Deployment Algorithm in 5G Communication based on Reinforcement Learning
    Xuan, Hejun
    Zhao, Xuelin
    Fan, Jianwei
    Xue, Yahui
    Zhu, Fangfang
    Li, Yanling
    [J]. IAENG International Journal of Computer Science, 2021, 48 (01)
  • [8] Toward Reinforcement-Learning-Based Service Deployment of 5G Mobile Edge Computing with Request-Aware Scheduling
    Zhai, Yanlong
    Bao, Tianhong
    Zhu, Liehuang
    Shen, Meng
    Du, Xiaojiang
    Guizani, Mohsen
    [J]. IEEE WIRELESS COMMUNICATIONS, 2020, 27 (01) : 84 - 91
  • [9] A Reliability-aware 5G Network Slice Reconfiguration and Embedding Algorithm
    Zhao Guofan
    Tang Lun
    Hu Yanjuan
    Zhao Peipei
    Chen Qianbin
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2020, 42 (06) : 1478 - 1485
  • [10] Service Aware Orchestration for Dynamic Network Slicing in 5G Networks
    Kim, Jeongyun
    [J]. ADVANCES IN COMPUTER SCIENCE AND UBIQUITOUS COMPUTING, 2018, 474 : 1397 - 1402