Service migration for mobile edge computing based on partially observable Markov decision processes

被引:11
|
作者
Chen, Wen [1 ]
Chen, Yuhu [1 ]
Liu, Jiawei [1 ]
机构
[1] Donghua Univ, Sch Informat Sci & Technol, Shanghai, Peoples R China
关键词
Mobile edge computing; Multi-user service migration; Deep reinforcement learning; Partially observable Markov decision processes; VIRTUAL MACHINE;
D O I
10.1016/j.compeleceng.2022.108552
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With the continuous development of mobile edge computing, people are more willing to offload tasks to edge servers that are closer to users than cloud services for a better user experience. Due to problems such as user mobility and limited coverage of edge servers, how to ensure service quality and prevent service interruption is a problem we have to consider. This article explores the problem of service migration to decide when, where, and how to migrate an ongoing service from the current edge server to the target edge server. At the same time, we will consider the premise that edge servers can only obtain partial user information, and model the service migration problem as a partially observable Markov decision process. To minimize user delay and system energy consumption, we propose a service migration decision algorithm based on Deep recurrent Q-learning (DRQNSM). Multiple experiments show that our algorithm has a better performance than some classical reinforcement learning algorithms.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Optimization of Service Migration Decisions in Mobile Edge Computing Based on Markov Decision Processes
    Zhang, Xiaoming
    Wen, Zhan
    Tang, Ran
    Wang, Xiaoke
    Liu, Hantao
    He, Miao
    Ren, Dehao
    Li, Wenzao
    2024 3RD INTERNATIONAL JOINT CONFERENCE ON INFORMATION AND COMMUNICATION ENGINEERING, JCICE 2024, 2024, : 92 - 96
  • [2] Dynamic Service Migration with Partially Observable Information in Mobile Edge Computing
    Li, Xiaoqian
    Zhou, Yakun
    Sun, Yao
    Chen, Siyu
    Chen, Jienan
    Feng, Gang
    2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [3] Dynamic Service Migration in Mobile Edge Computing Based on Markov Decision Process
    Wang, Shiqiang
    Urgaonkar, Rahul
    Zafer, Murtaza
    He, Ting
    Chan, Kevin
    Leung, Kin K.
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2019, 27 (03) : 1272 - 1288
  • [4] Partially Observable Markov Decision Processes and Robotics
    Kurniawati, Hanna
    ANNUAL REVIEW OF CONTROL ROBOTICS AND AUTONOMOUS SYSTEMS, 2022, 5 : 253 - 277
  • [5] A tutorial on partially observable Markov decision processes
    Littman, Michael L.
    JOURNAL OF MATHEMATICAL PSYCHOLOGY, 2009, 53 (03) : 119 - 125
  • [6] Quantum partially observable Markov decision processes
    Barry, Jennifer
    Barry, Daniel T.
    Aaronson, Scott
    PHYSICAL REVIEW A, 2014, 90 (03):
  • [7] PARTIALLY OBSERVABLE MARKOV DECISION PROCESSES WITH PARTIALLY OBSERVABLE RANDOM DISCOUNT FACTORS
    Martinez-Garcia, E. Everardo
    Minjarez-Sosa, J. Adolfo
    Vega-Amaya, Oscar
    KYBERNETIKA, 2022, 58 (06) : 960 - 983
  • [8] Partially observable Markov decision processes for risk-based screening
    Mrozack, Alex
    Liao, Xuejun
    Skatter, Sondre
    Carin, Lawrence
    ANOMALY DETECTION AND IMAGING WITH X-RAYS (ADIX), 2016, 9847
  • [9] Active learning in partially observable Markov decision processes
    Jaulmes, R
    Pineau, J
    Precup, D
    MACHINE LEARNING: ECML 2005, PROCEEDINGS, 2005, 3720 : 601 - 608
  • [10] Structural Estimation of Partially Observable Markov Decision Processes
    Chang, Yanling
    Garcia, Alfredo
    Wang, Zhide
    Sun, Lu
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2023, 68 (08) : 5135 - 5141