Reinforcement-Learning-Assisted Service Function Chain Embedding Algorithm in Edge Computing Networks

被引:0
|
作者
Wang, Wei [1 ]
Chen, Shengpeng [2 ]
Zhang, Peiying [2 ,3 ]
Liu, Kai [4 ,5 ]
机构
[1] Guangzhou Panyu Polytech, Sch Informat Engn, Guangzhou 511483, Peoples R China
[2] China Univ Petr East China, Qingdao Inst Software, Coll Comp Sci & Technol, Qingdao 266580, Peoples R China
[3] Qilu Univ Technol, Shandong Acad Sci, Key Lab Comp Power Network & Informat Secur, Minist Educ,Shandong Comp Sci Ctr,Natl Supercomp C, Jinan 250013, Peoples R China
[4] Tsinghua Univ, State Key Lab Space Network & Commun, Beijing 100084, Peoples R China
[5] Tsinghua Univ, Beijing Natl Res Ctr Informat Sci & Technol, Beijing 100084, Peoples R China
基金
中国国家自然科学基金;
关键词
edge computing; resource allocation; service function chaining; distributed reinforcement learning; RESOURCE-ALLOCATION;
D O I
10.3390/electronics13153007
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Edge computing networks are critical infrastructures for processing massive data and providing instantaneous services. However, how to efficiently allocate resources in edge computing networks to meet the embedding requirements of service function chains has become an urgent problem. In this paper, we model the resource allocation problem in edge computing networks as a service function chain embedding problem model, aiming to optimize the resource allocation through reinforcement learning algorithms to achieve the goals of low cost, high revenue, and high embedding rate. In this paper, the basic concepts of edge computing network and service function chain are elaborated, and the resource allocation problem is transformed into a service function chain embedding problem by establishing a mathematical model, which provides a foundation for the subsequent algorithm design. In this paper, a service function chain embedding algorithm based on reinforcement learning is designed to gradually optimize the resource allocation decision by simulating the learning process. In order to verify the effectiveness of the algorithm, a series of simulation experiments are conducted in this paper and compared with other algorithms. The experimental results show that the service function chain embedding algorithm based on reinforcement learning proposed in this paper exhibits superior performance in resource allocation. Compared with traditional resource allocation methods, the algorithm achieves significant improvement in terms of low cost, high revenue, and high embedding rate.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Deep Reinforcement Learning based Service Migration Strategy for Edge Computing
    Gao, Zhipeng
    Jiao, Qidong
    Xiao, Kaile
    Wang, Qian
    Mo, Zijia
    Yang, Yang
    [J]. 2019 13TH IEEE INTERNATIONAL CONFERENCE ON SERVICE-ORIENTED SYSTEM ENGINEERING (SOSE) / 10TH INTERNATIONAL WORKSHOP ON JOINT CLOUD COMPUTING (JCC) / IEEE INTERNATIONAL WORKSHOP ON CLOUD COMPUTING IN ROBOTIC SYSTEMS (CCRS), 2019, : 116 - 121
  • [32] Deep Reinforcement Learning Driven UAV-Assisted Edge Computing
    Zhang, Liang
    Jabbari, Bijan
    Ansari, Nirwan
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (24) : 25449 - 25459
  • [33] A Reinforcement Learning assisted Backoff Algorithm for LoRa networks
    Valkanis, Anastasios
    Beletsioti, Georgia A.
    Kantelis, Konstantinos
    Nicopolitidis, Petros
    Papadimitriou, Georgios
    [J]. PROCEEDINGS OF THE 2021 IEEE INTERNATIONAL CONFERENCE ON COMPUTER, INFORMATION, AND TELECOMMUNICATION SYSTEMS (IEEE CITS 2021), 2021, : 69 - 74
  • [34] A Learning Algorithm for Real-time Service In Vehicular Networks with Mobile-Edge Computing
    Dai, Penglin
    Liu, Kai
    Wu, Xiao
    Xing, Huanlai
    Yu, Zhaofei
    Lee, Victor C. S.
    [J]. ICC 2019 - 2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2019,
  • [35] Robust Service Provisioning With Service Function Chain Requirements in Mobile Edge Computing
    Li, Jing
    Liang, Weifa
    Ma, Yu
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2021, 18 (02): : 2138 - 2153
  • [36] A Fast Resource Allocation Algorithm Based on Reinforcement Learning in Edge Computing Networks Considering User Cooperation
    Jin, Yichen
    Chen, Ziwei
    [J]. ELECTRONICS, 2023, 12 (06)
  • [37] Unsupervised Deep Learning for Distributed Service Function Chain Embedding
    Rodis, Panteleimon
    Papadimitriou, Panagiotis
    [J]. IEEE ACCESS, 2023, 11 : 91660 - 91672
  • [38] Distributed Edge Computing Offloading Algorithm Based on Deep Reinforcement Learning
    Li, Yunzhao
    Qi, Feng
    Wang, Zhili
    Yu, Xiuming
    Shao, Sujie
    [J]. IEEE ACCESS, 2020, 8 : 85204 - 85215
  • [39] A Reinforcement Learning Algorithm for Resource Provisioning in Mobile Edge Computing Network
    Huynh Thi Thanh Binh
    Nguyen Phi Le
    Nguyen Binh Minh
    Trinh Thu Hai
    Ngo Quang Minh
    Do Bao Son
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [40] Computing and Communication Cost-Aware Service Migration Enabled by Transfer Reinforcement Learning for Dynamic Vehicular Edge Computing Networks
    Peng, Yan
    Tang, Xiaogang
    Zhou, Yiqing
    Li, Jintao
    Qi, Yanli
    Liu, Ling
    Lin, Hai
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (01) : 257 - 269