Deep Reinforcement Learning-Based Offloading Decision Optimization in Mobile Edge Computing

被引:15
|
作者
Zhang, Hao [1 ]
Wu, Wenjun [1 ]
Wang, Chaoyi [1 ]
Li, Meng [1 ]
Yang, Ruizhe [1 ]
机构
[1] Beijing Univ Technol, Fac Informat Technol, Beijing, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Mobile edge computing; deep reinforcement learning; Markov decision process; wireless networks; RESOURCE-ALLOCATION; RANDOM-ACCESS; NETWORKS;
D O I
10.1109/WCNC.2019.8886332
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
As a promising technique, mobile edge computing (MEC) has attracted significant attention from both academia and industry. However, the offloading decision for computing tasks in MEC is usually complicated and intractable. In this paper, we propose a novel framework for offloading decision in MEC based on Deep Reinforcement Learning (DRL). We consider a typical network architecture with one MEC server and one mobile user, in which the tasks of the device arrive as a flow in time. We model the offloading decision process of the task flow as a Markov Decision Process (MDP). The optimization object is minimizing the weighted sum of offloading latency and power consumption, which is decomposed into the reward of each time slot. The elements of DRL such as policy, reward and value are defined according to the proposed optimization problem. Simulation results reveal that the proposed method could significantly reduce the energy consumption and latency compared to the existing schemes.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] Task Offloading Optimization in Mobile Edge Computing based on Deep Reinforcement Learning
    Silva, Carlos
    Magaia, Naercio
    Grilo, Antonio
    [J]. PROCEEDINGS OF THE INT'L ACM CONFERENCE ON MODELING, ANALYSIS AND SIMULATION OF WIRELESS AND MOBILE SYSTEMS, MSWIM 2023, 2023, : 109 - 118
  • [2] Deep reinforcement learning-based online task offloading in mobile edge computing networks
    Wu, Haixing
    Geng, Jingwei
    Bai, Xiaojun
    Jin, Shunfu
    [J]. INFORMATION SCIENCES, 2024, 654
  • [3] Deep Reinforcement Learning-based computation offloading and distributed edge service caching for Mobile Edge Computing
    Xie, Mande
    Ye, Jiefeng
    Zhang, Guoping
    Ni, Xueping
    [J]. COMPUTER NETWORKS, 2024, 250
  • [4] DRL-OS: A Deep Reinforcement Learning-Based Offloading Scheduler in Mobile Edge Computing
    Lim, Ducsun
    Lee, Wooyeob
    Kim, Won-Tae
    Joe, Inwhee
    [J]. SENSORS, 2022, 22 (23)
  • [5] Deep Reinforcement Learning-Based Computation Offloading in Vehicular Edge Computing
    Zhan, Wenhan
    Luo, Chunbo
    Wang, Jin
    Min, Geyong
    Duan, Hancong
    [J]. 2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [6] ADRLO: Adaptive deep reinforcement learning-based offloading for edge computing
    Li, Zhigang
    Wang, Yutong
    Zhang, Wentao
    Li, Shujie
    Sun, Xiaochuan
    [J]. PHYSICAL COMMUNICATION, 2023, 61
  • [7] Optimization of lightweight task offloading strategy for mobile edge computing based on deep reinforcement learning
    Lu, Haifeng
    Gu, Chunhua
    Luo, Fei
    Ding, Weichao
    Liu, Xinping
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2020, 102 : 847 - 861
  • [8] Computation offloading Optimization in Edge Computing based on Deep Reinforcement Learning
    Zhu Qinghua
    Chang Ying
    Zhao Jingya
    Liu Yong
    [J]. 2020 5TH INTERNATIONAL CONFERENCE ON MECHANICAL, CONTROL AND COMPUTER ENGINEERING (ICMCCE 2020), 2020, : 1552 - 1558
  • [9] Distributed Deep Learning-based Offloading for Mobile Edge Computing Networks
    Liang Huang
    Xu Feng
    Anqi Feng
    Yupin Huang
    Li Ping Qian
    [J]. Mobile Networks and Applications, 2022, 27 : 1123 - 1130
  • [10] Distributed Deep Learning-based Offloading for Mobile Edge Computing Networks
    Huang, Liang
    Feng, Xu
    Feng, Anqi
    Huang, Yupin
    Qian, Li Ping
    [J]. MOBILE NETWORKS & APPLICATIONS, 2022, 27 (03): : 1123 - 1130