Dynamic task offloading for Internet of Things in mobile edge computing via deep reinforcement learning

被引:45
|
作者
Chen, Ying [1 ]
Gu, Wei [1 ]
Li, Kaixin [1 ]
机构
[1] Beijing Informat Sci & Technol Univ, Comp Sci, 35 Beisihuan Middle Rd, Beijing 100101, Peoples R China
基金
中国国家自然科学基金;
关键词
deep reinforcement learning (DRL); Internet of Things (IoT); mobile edge computing (MEC); task offloading; RESOURCE-ALLOCATION;
D O I
10.1002/dac.5154
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With the development of Internet of Things (IoT), more and more computation-intensive tasks are generated by IoT devices. Due to the limitation of battery and computing capacity of IoT devices, these tasks can be offloaded to mobile edge computing (MEC) and cloud for processing. However, as the channel states and task generation process are dynamic, and the scales of task offloading problem and solution space size are increasing rapidly, the collaborative task offloading for MEC and cloud faces severe challenges. In this paper, we integrate the two conflicting offloading goals, which are maximizing the task finish ratio with tolerable delay and minimizing the power consumption of devices. We formulate the task offloading problem to balance the two conflicting goals. Then, we reformulate it as an MDP-based dynamic task offloading problem. We design a deep reinforcement learning (DRL)-based dynamic task offloading (DDTO) algorithm to solve this problem. Our DDTO algorithm can adapt to the dynamic and complex environment and adjust the task offloading strategies accordingly. Experiments are also carried out which show that our DDTO algorithm can converge quickly. The experiment results also validate the effectiveness and efficacy of our DDTO algorithm in balancing finish ratio and power.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] Secure Task Offloading in Blockchain-Enabled Mobile Edge Computing With Deep Reinforcement Learning
    Samy, Ahmed
    Elgendy, Ibrahim A.
    Yu, Haining
    Zhang, Weizhe
    Zhang, Hongli
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2022, 19 (04): : 4872 - 4887
  • [32] Task Offloading and Resource Allocation for Mobile Edge Computing by Deep Reinforcement Learning Based on SARSA
    Alfakih, Taha
    Hassan, Mohammad Mehedi
    Gumaei, Abdu
    Savaglio, Claudio
    Fortino, Giancarlo
    [J]. IEEE ACCESS, 2020, 8 : 54074 - 54084
  • [33] A dynamic queuing model based distributed task offloading algorithm using deep reinforcement learning in mobile edge computing
    Zhengyi Chai
    Haole Hou
    Yalun Li
    [J]. Applied Intelligence, 2023, 53 : 28832 - 28847
  • [34] Deep Reinforcement Learning-Based Dynamic Resource Management for Mobile Edge Computing in Industrial Internet of Things
    Chen, Ying
    Liu, Zhiyong
    Zhang, Yongchao
    Wu, Yuan
    Chen, Xin
    Zhao, Lian
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (07) : 4925 - 4934
  • [35] A dynamic queuing model based distributed task offloading algorithm using deep reinforcement learning in mobile edge computing
    Chai, Zhengyi
    Hou, Haole
    Li, Yalun
    [J]. APPLIED INTELLIGENCE, 2023, 53 (23) : 28832 - 28847
  • [36] Dependent Task Offloading for Edge Computing based on Deep Reinforcement Learning
    Wang, Jin
    Hu, Jia
    Min, Geyong
    Zhan, Wenhan
    Zomaya, Albert Y.
    Georgalas, Nektarios
    [J]. IEEE TRANSACTIONS ON COMPUTERS, 2022, 71 (10) : 2449 - 2461
  • [37] Deep Reinforcement Learning Based Task Offloading Strategy Under Dynamic Pricing in Edge Computing
    Shi, Bing
    Chen, Feiyang
    Tang, Xing
    [J]. SERVICE-ORIENTED COMPUTING (ICSOC 2021), 2021, 13121 : 578 - 594
  • [38] Mobile-Aware Online Task Offloading Based on Deep Reinforcement Learning in Mobile Edge Computing Networks
    Li, Yuting
    Liu, Yitong
    Liu, Xingcheng
    Tu, Qiang
    Xie, Yi
    [J]. 2023 IEEE 34TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS, PIMRC, 2023,
  • [39] NOMA Assisted Multi-Task Multi-Access Mobile Edge Computing via Deep Reinforcement Learning for Industrial Internet of Things
    Qian, Liping
    Wu, Yuan
    Jiang, Fuli
    Yu, Ningning
    Lu, Weidang
    Lin, Bin
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (08) : 5688 - 5698
  • [40] Deep reinforcement learning for computation offloading in mobile edge computing environment
    Chen, Miaojiang
    Wang, Tian
    Zhang, Shaobo
    Liu, Anfeng
    [J]. COMPUTER COMMUNICATIONS, 2021, 175 (175) : 1 - 12