Service migration for mobile edge computing based on partially observable Markov decision processes

被引:11
|
作者
Chen, Wen [1 ]
Chen, Yuhu [1 ]
Liu, Jiawei [1 ]
机构
[1] Donghua Univ, Sch Informat Sci & Technol, Shanghai, Peoples R China
关键词
Mobile edge computing; Multi-user service migration; Deep reinforcement learning; Partially observable Markov decision processes; VIRTUAL MACHINE;
D O I
10.1016/j.compeleceng.2022.108552
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With the continuous development of mobile edge computing, people are more willing to offload tasks to edge servers that are closer to users than cloud services for a better user experience. Due to problems such as user mobility and limited coverage of edge servers, how to ensure service quality and prevent service interruption is a problem we have to consider. This article explores the problem of service migration to decide when, where, and how to migrate an ongoing service from the current edge server to the target edge server. At the same time, we will consider the premise that edge servers can only obtain partial user information, and model the service migration problem as a partially observable Markov decision process. To minimize user delay and system energy consumption, we propose a service migration decision algorithm based on Deep recurrent Q-learning (DRQNSM). Multiple experiments show that our algorithm has a better performance than some classical reinforcement learning algorithms.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] Learning factored representations for partially observable Markov decision processes
    Sallans, B
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 12, 2000, 12 : 1050 - 1056
  • [42] Partially Observable Markov Decision Processes: A Geometric Technique and Analysis
    Zhang, Hao
    OPERATIONS RESEARCH, 2010, 58 (01) : 214 - 228
  • [43] Partially Observable Risk-Sensitive Markov Decision Processes
    Baeuerle, Nicole
    Rieder, Ulrich
    MATHEMATICS OF OPERATIONS RESEARCH, 2017, 42 (04) : 1180 - 1196
  • [44] A Fast Approximation Method for Partially Observable Markov Decision Processes
    Liu Bingbing
    Kang Yu
    Jiang Xiaofeng
    Qin Jiahu
    JOURNAL OF SYSTEMS SCIENCE & COMPLEXITY, 2018, 31 (06) : 1423 - 1436
  • [45] Quasi-Deterministic Partially Observable Markov Decision Processes
    Besse, Camille
    Chaib-draa, Brahim
    NEURAL INFORMATION PROCESSING, PT 1, PROCEEDINGS, 2009, 5863 : 237 - 246
  • [46] Service Migration in Mobile Edge Computing
    Wang, Shangguang
    Chou, Wu
    Wong, Kok-Seng
    Zhou, Ao
    Leung, Victor C.
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2018,
  • [47] Decision making under uncertainty: a neural model based on partially observable Markov decision processes
    Rao, Rajesh P. N.
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2010, 4
  • [48] Mobile agent-based service migration in mobile edge computing
    Guo, Yongan
    Jiang, Chunlei
    Wu, Tin-Yu
    Wang, Anzhi
    INTERNATIONAL JOURNAL OF COMMUNICATION SYSTEMS, 2021, 34 (03)
  • [49] Scalable grid-based approximation algorithms for partially observable Markov decision processes
    Kavaklioglu, Can
    Cevik, Mucahit
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2022, 34 (05):
  • [50] Point-Based Methods for Model Checking in Partially Observable Markov Decision Processes
    Bouton, Maxime
    Tumova, Jana
    Kochenderfer, Mykel J.
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 10061 - 10068