Deep reinforcement learning-based task offloading and service migrating policies in service caching-assisted mobile edge computing

被引:0
|
作者
Ke, Hongchang [1 ]
Hui, Wan [2 ]
Sun, Hongbin [1 ]
Yan, Halvin [3 ]
机构
[1] Changchun Inst Technol, Sch Comp Technol & Engn, Changchun 130012, Peoples R China
[2] Changchun Univ Technol, Coll Comp Sci & Engn, Changchun 130012, Peoples R China
[3] UCL, Dept Elect & Elect Engn, London, England
关键词
deep reinforcement learning; mobile edge computing; service caching; service migrating; NETWORKS; MEC;
D O I
10.23919/JCC.fa.2023-0474.202404
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Emerging mobile edge computing (MEC) is considered a feasible solution for offloading the computation-intensive request tasks generated from mobile wireless equipment (MWE) with limited computational resources and energy. Due to the homogeneity of request tasks from one MWE during a long-term time period, it is vital to predeploy the particular service cachings required by the request tasks at the MEC server. In this paper, we model a service caching-assisted MEC framework that takes into account the constraint on the number of service cachings hosted by each edge server and the migration of request tasks from the current edge server to another edge server with service caching required by tasks. Furthermore, we propose a multiagent deep reinforcement learning-based computation offloading and task migrating decision-making scheme (MBOMS) to minimize the long-term average weighted cost. The proposed MBOMS can learn the near-optimal offloading and migrating decision-making policy by centralized training and decentralized execution. Systematic and comprehensive simulation results reveal that our proposed MBOMS can converge well after training and outperforms the other five baseline algorithms.
引用
收藏
页码:88 / 103
页数:16
相关论文
共 50 条
  • [1] Deep Reinforcement Learning-Based Task Offloading and Service Migrating Policies in Service Caching-Assisted Mobile Edge Computing
    Ke Hongchang
    Wang Hui
    Sun Hongbin
    Halvin Yang
    [J]. China Communications, 2024, 21 (04) : 88 - 103
  • [2] Deep Reinforcement Learning-based computation offloading and distributed edge service caching for Mobile Edge Computing
    Xie, Mande
    Ye, Jiefeng
    Zhang, Guoping
    Ni, Xueping
    [J]. COMPUTER NETWORKS, 2024, 250
  • [3] Lyapunov-guided Deep Reinforcement Learning for service caching and task offloading in Mobile Edge Computing
    Li, Nianxin
    Zhai, Linbo
    Ma, Zeyao
    Zhu, Xiumin
    Li, Yumei
    [J]. COMPUTER NETWORKS, 2024, 250
  • [4] Deep reinforcement learning-based online task offloading in mobile edge computing networks
    Wu, Haixing
    Geng, Jingwei
    Bai, Xiaojun
    Jin, Shunfu
    [J]. INFORMATION SCIENCES, 2024, 654
  • [5] Collaborative Task Offloading and Service Caching Strategy for Mobile Edge Computing
    Liu, Xiang
    Zhao, Xu
    Liu, Guojin
    Huang, Fei
    Huang, Tiancong
    Wu, Yucheng
    [J]. SENSORS, 2022, 22 (18)
  • [6] Energy Efficient Joint Computation Offloading and Service Caching for Mobile Edge Computing: A Deep Reinforcement Learning Approach
    Zhou, Huan
    Zhang, Zhenyu
    Wu, Yuan
    Dong, Mianxiong
    Leung, Victor C. M.
    [J]. IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2023, 7 (02): : 950 - 961
  • [7] Hierarchical Deep Reinforcement Learning for Joint Service Caching and Computation Offloading in Mobile Edge-Cloud Computing
    Sun, Chuan
    Li, Xiuhua
    Wang, Chenyang
    He, Qiang
    Wang, Xiaofei
    Leung, Victor C. M.
    [J]. IEEE TRANSACTIONS ON SERVICES COMPUTING, 2024, 17 (04) : 1548 - 1564
  • [8] Task Offloading With Service Migration for Satellite Edge Computing: A Deep Reinforcement Learning Approach
    Wu, Haonan
    Yang, Xiumei
    Bu, Zhiyong
    [J]. IEEE ACCESS, 2024, 12 : 25844 - 25856
  • [9] Research on Task Offloading Based on Deep Reinforcement Learning in Mobile Edge Computing
    Lu H.
    Gu C.
    Luo F.
    Ding W.
    Yang T.
    Zheng S.
    [J]. Gu, Chunhua (chgu@ecust.edu.cn), 1600, Science Press (57): : 1539 - 1554
  • [10] Joint Service Caching and Task Offloading for Mobile Edge Computing in Dense Networks
    Xu, Jie
    Chen, Lixing
    Zhou, Pan
    [J]. IEEE CONFERENCE ON COMPUTER COMMUNICATIONS (IEEE INFOCOM 2018), 2018, : 207 - 215