Computation offloading Optimization in Edge Computing based on Deep Reinforcement Learning

被引:3
|
作者
Zhu Qinghua [1 ]
Chang Ying [1 ]
Zhao Jingya [1 ]
Liu Yong [1 ]
机构
[1] Beijing Polytech, Sch Telecommun Engn, Beijing, Peoples R China
关键词
mobile edge computation; resource allocation; computation offloading; deep reinforcement learning; MOBILE; RESOURCE; RADIO;
D O I
10.1109/ICMCCE51767.2020.00340
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
By considering an MEC system consisting of multiple mobile devices with stochastic task arrivals, a computational offloading and resource allocation strategy based on Deep Reinforcement Learning (DRL) is proposed. Specifically, a continuous action space based DRL approach named deep deterministic policy gradient (DDPG) is adopted to learn efficient computation offloading policies independently at each mobile user. Thus, powers of both local execution and task offloading can be adaptively allocated by the learned policies from each user's local observation of the MEC system. Through simulation, it can be verified that efficient policies can be learned at each mobile device, and the performance of the DDPG-based strategy is better than the traditional deep Q network (DQN) -based discrete power control strategy, which reduces the computation cost.
引用
收藏
页码:1552 / 1558
页数:7
相关论文
共 50 条
  • [1] Computation Offloading in Edge Computing Based on Deep Reinforcement Learning
    Li, MingChu
    Mao, Ning
    Zheng, Xiao
    Gadekallu, Thippa Reddy
    [J]. PROCEEDINGS OF INTERNATIONAL CONFERENCE ON COMPUTING AND COMMUNICATION NETWORKS (ICCCN 2021), 2022, 394 : 339 - 353
  • [2] Deep Reinforcement Learning-Based Computation Offloading in Vehicular Edge Computing
    Zhan, Wenhan
    Luo, Chunbo
    Wang, Jin
    Min, Geyong
    Duan, Hancong
    [J]. 2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [3] Deep reinforcement learning for the computation offloading in MIMO-based Edge Computing
    Sadiki, Abdeladim
    Bentahar, Jamal
    Dssouli, Rachida
    En-Nouaary, Abdeslam
    Otrok, Hadi
    [J]. AD HOC NETWORKS, 2023, 141
  • [4] A Distributed Computation Offloading Strategy for Edge Computing Based on Deep Reinforcement Learning
    Lai, Hongyang
    Yang, Zhuocheng
    Li, Jinhao
    Wu, Celimuge
    Bao, Wugedele
    [J]. MOBILE NETWORKS AND MANAGEMENT, MONAMI 2021, 2022, 418 : 73 - 86
  • [5] Deep reinforcement learning for computation offloading in mobile edge computing environment
    Chen, Miaojiang
    Wang, Tian
    Zhang, Shaobo
    Liu, Anfeng
    [J]. COMPUTER COMMUNICATIONS, 2021, 175 : 1 - 12
  • [6] Binary Computation Offloading in Edge Computing Using Deep Reinforcement Learning
    Rajwar, Dipankar
    Kumar, Dinesh
    [J]. ADVANCED NETWORK TECHNOLOGIES AND INTELLIGENT COMPUTING, ANTIC 2023, PT II, 2024, 2091 : 215 - 227
  • [7] Deep Reinforcement Learning Based Computation Offloading in UAV-Assisted Edge Computing
    Zhang, Peiying
    Su, Yu
    Li, Boxiao
    Liu, Lei
    Wang, Cong
    Zhang, Wei
    Tan, Lizhuang
    [J]. DRONES, 2023, 7 (03)
  • [8] Task Offloading Optimization in Mobile Edge Computing based on Deep Reinforcement Learning
    Silva, Carlos
    Magaia, Naercio
    Grilo, Antonio
    [J]. PROCEEDINGS OF THE INT'L ACM CONFERENCE ON MODELING, ANALYSIS AND SIMULATION OF WIRELESS AND MOBILE SYSTEMS, MSWIM 2023, 2023, : 109 - 118
  • [9] A Deep Reinforcement Learning Based Offloading Game in Edge Computing
    Zhan, Yufeng
    Guo, Song
    Li, Peng
    Zhang, Jiang
    [J]. IEEE TRANSACTIONS ON COMPUTERS, 2020, 69 (06) : 883 - 893
  • [10] A Deep Reinforcement Learning Approach for Online Computation Offloading in Mobile Edge Computing
    Zhang, Yameng
    Liu, Tong
    Zhu, Yanmin
    Yang, Yuanyuan
    [J]. 2020 IEEE/ACM 28TH INTERNATIONAL SYMPOSIUM ON QUALITY OF SERVICE (IWQOS), 2020,