Deep Reinforcement Learning based Mobility-Aware Service Migration for Multi-access Edge Computing Environment

被引:1
|
作者
Zhang, Yaqiang [1 ,2 ,3 ]
Li, Rengang [1 ,2 ]
Zhao, Yaqian [1 ,2 ]
Li, Ruyang [1 ,2 ]
机构
[1] Inspur Beijing Elect Informat Ind Co Ltd, Beijing 100085, Peoples R China
[2] Inspur Elect Informat Ind Co Ltd, Jinan 250101, Peoples R China
[3] Shandong Mass Informat Technol Res Inst, Jinan 250101, Peoples R China
关键词
Service Migration; Multi-access Edge Computing; Deep Reinforcement Learning; Mobility-Aware;
D O I
10.1109/ISCC55528.2022.9912842
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-access Edge Computing (MEC) plays an important role for providing end users with high reliability and low latency services at the edge of mobile network. In the scenario of Internet of Vehicles (IoV), vehicle users continually access nearby base stations to offload real-time tasks for reducing their computing overhead, while the ongoing services on current deployed edge nodes may be far away from users with the vehicles moving, potentially resulting in a high delay of data transmission. To address this challenge, in this paper, we propose a Deep Reinforcement Learning (DRL)-based mobility-aware service migration mechanism for effectively reducing the service delay and migration delay of the network. The proposed technique is adopted by re-calibrating required services at edge locations near the mobile user. Edge network state and user movement information are considered to ensure the generation of real-time service migration decision. Extensive experiments are conducted, and evaluation results demonstrate that our proposed DRL-based technique can effectively reduce the long-term average delay of the MEC system, compared with the state-of-the-art techniques.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Mobility-Aware Resource Allocation in Multi-Access Edge Computing using Deep Reinforcement Learning
    Din, Najamul
    Chen, Haopeng
    Khan, Daud
    [J]. 2019 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2019), 2019, : 202 - 209
  • [2] A DEEP REINFORCEMENT LEARNING APPROACH FOR DATA MIGRATION IN MULTI-ACCESS EDGE COMPUTING
    De Vita, Fabrizio
    Bruneo, Dario
    Puliafito, Antonio
    Nardini, Giovanni
    Virdis, Antonio
    Stea, Giovanni
    [J]. 2018 ITU KALEIDOSCOPE: MACHINE LEARNING FOR A 5G FUTURE (ITU K), 2018,
  • [3] Mobility-Aware Deep Reinforcement Learning with Glimpse Mobility Prediction in Edge Computing
    Wu, Chao-Lun
    Chiu, Te-Chuan
    Wang, Chih-Yu
    Pang, Ai-Chun
    [J]. ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
  • [4] A Novel Mobility-Aware Offloading Management Scheme in Sustainable Multi-Access Edge Computing
    Guan, Shichao
    Boukerche, Azzedine
    [J]. IEEE TRANSACTIONS ON SUSTAINABLE COMPUTING, 2022, 7 (01): : 1 - 13
  • [5] A Mobility-Aware Service Function Chain Migration Strategy Based on Deep Reinforcement Learning
    Hefei Hu
    Wei Zhang
    Lingyi Xu
    Panjie Qi
    [J]. Journal of Network and Systems Management, 2023, 31
  • [6] A Mobility-Aware Service Function Chain Migration Strategy Based on Deep Reinforcement Learning
    Hu, Hefei
    Zhang, Wei
    Xu, Lingyi
    Qi, Panjie
    [J]. JOURNAL OF NETWORK AND SYSTEMS MANAGEMENT, 2023, 31 (01)
  • [7] Mobility-Aware Edge Caching and Computing in Vehicle Networks: A Deep Reinforcement Learning
    Le Thanh Tan
    Hu, Rose Qingyang
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2018, 67 (11) : 10190 - 10203
  • [8] Service migration in multi-access edge computing: A joint state adaptation and reinforcement learning mechanism
    Rui, LanLan
    Zhang, Menglei
    Gao, Zhipeng
    Qiu, Xuesong
    Wang, Zhili
    Xiong, Ao
    [J]. JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2021, 183
  • [9] Service migration in multi-access edge computing: A joint state adaptation and reinforcement learning mechanism
    Rui, LanLan
    Zhang, Menglei
    Gao, Zhipeng
    Qiu, Xuesong
    Wang, Zhili
    Xiong, Ao
    [J]. Journal of Network and Computer Applications, 2021, 183-184
  • [10] A survey of mobility-aware Multi-access Edge Computing: Challenges, use cases and future directions
    Singh, Ramesh
    Sukapuram, Radhika
    Chakraborty, Suchetana
    [J]. AD HOC NETWORKS, 2023, 140