Reliable Service Function Chain Deployment Method Based on Deep Reinforcement Learning

被引:0
|
作者
Qu, Hua [1 ,2 ]
Wang, Ke [1 ]
Zhao, Jihong [2 ,3 ]
机构
[1] Xi An Jiao Tong Univ, Sch Software Engn, Xian 710049, Peoples R China
[2] Xi An Jiao Tong Univ, Sch Elect & Informat Engn, Xian 710049, Peoples R China
[3] Xian Univ Posts & Telecommun, Sch Commun & Informat Engn, Xian 710061, Peoples R China
基金
国家重点研发计划;
关键词
network function virtualization; service function chain; reliable; priority-awareness; deep reinforcement learning;
D O I
10.3390/s21082733
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Network function virtualization (NFV) is a key technology to decouple hardware device and software function. Several virtual network functions (VNFs) combine into a function sequence in a certain order, that is defined as service function chain (SFC). A significant challenge is guaranteeing reliability. First, deployment server is selected to place VNF, then, backup server is determined to place the VNF as a backup which is running when deployment server is failed. Moreover, how to determine the accurate locations dynamically with machine learning is challenging. This paper focuses on resource requirements of SFC to measure its priority meanwhile calculates node priority by current resource capacity and node degree, then, a novel priority-awareness deep reinforcement learning (PA-DRL) algorithm is proposed to implement reliable SFC dynamically. PA-DRL determines the backup scheme of each VNF, then, the model jointly utilizes delay, load balancing of network as feedback factors to optimize the quality of service. In the experimental results, resource efficient utilization, survival rate, and load balancing of PA-DRL were improved by 36.7%, 35.1%, and 78.9% on average compared with benchmark algorithm respectively, average delay was reduced by 14.9%. Therefore, PA-DRL can effectively improve reliability and optimization targets compared with other benchmark methods.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Reliable Deployment Algorithm of Service Function Chain Based on Deep Reinforcement Learning
    Tang Lun
    Cao Rui
    Liao Hao
    Wang Zhaokun
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2020, 42 (12) : 2931 - 2938
  • [2] Dynamic Service Function Chain Deployment and Readjustment Method Based on Deep Reinforcement Learning
    Ran, Jing
    Wang, Wenkai
    Hu, Hefei
    [J]. SENSORS, 2023, 23 (06)
  • [3] A Reliable Service Function Chain Orchestration Method Based on Federated Reinforcement Learning
    Xiao, Zhiwen
    Tao, Tao
    Chen, Zhuo
    Yang, Meng
    Shang, Jing
    Wu, Zhihui
    Guo, Zhiwei
    [J]. COLLABORATIVE COMPUTING: NETWORKING, APPLICATIONS AND WORKSHARING, COLLABORATECOM 2022, PT I, 2022, 460 : 173 - 189
  • [4] Service Function Chain Deployment Algorithm Based on Multi-Agent Deep Reinforcement Learning
    Huang, Wanwei
    Zhang, Qiancheng
    Liu, Tao
    Xu, Yaoli
    Zhang, Dalei
    [J]. Computers, Materials and Continua, 2024, 80 (03): : 4875 - 4893
  • [5] NFVdeep: Adaptive Online Service Function Chain Deployment with Deep Reinforcement Learning
    Xiao, Yikai
    Zhang, Qixia
    Liu, Fangming
    Wang, Jia
    Zhao, Miao
    Zhang, Zhongxing
    Zhang, Jiaxing
    [J]. PROCEEDINGS OF THE IEEE/ACM INTERNATIONAL SYMPOSIUM ON QUALITY OF SERVICE (IWQOS 2019), 2019,
  • [6] An Improved Adaptive Service Function Chain Mapping Method Based on Deep Reinforcement Learning
    Huang, Wanwei
    Li, Song
    Wang, Sunan
    Li, Hui
    [J]. ELECTRONICS, 2023, 12 (06)
  • [7] Reliability deployment of service function chain based on multi-agent reinforcement learning
    Liu, Guangyuan
    Huang, Shucui
    Li, Kai
    [J]. 2022 IEEE 6TH ADVANCED INFORMATION TECHNOLOGY, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IAEAC), 2022, : 1574 - 1578
  • [8] Service Function Chain Deployment Algorithm Based on Deep Reinforcement Learning in Space-Air-Ground Integrated Network
    Feng, Xu
    He, Mengyang
    Zhuang, Lei
    Song, Yanrui
    Peng, Rumeng
    [J]. FUTURE INTERNET, 2024, 16 (01)
  • [9] Online Service Function Chain Deployment Method Based on Deep Q Network
    Qiu Hang
    Tang Hongbo
    You Wei
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2021, 43 (11) : 3122 - 3130
  • [10] Priority-Aware Deployment of Autoscaling Service Function Chains Based on Deep Reinforcement Learning
    Yu, Xue
    Wang, Ran
    Hao, Jie
    Wu, Qiang
    Yi, Changyan
    Wang, Ping
    Niyato, Dusit
    [J]. IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2024, 10 (03) : 1050 - 1062