Dynamic Computation Offloading with Deep Reinforcement Learning in Edge Network

被引:1
|
作者
Bai, Yang [1 ]
Li, Xiaocui [1 ]
Wu, Xinfan [1 ]
Zhou, Zhangbing [1 ,2 ]
机构
[1] China Univ Geosci Beijing, Sch Informat Engn, Beijing 100083, Peoples R China
[2] TELECOM SudParis, Comp Sci Dept, F-91000 Evry, France
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 03期
基金
中国国家自然科学基金;
关键词
computation offloading; service migration; deep reinforcement learning; SERVICE MIGRATION; ENERGY; OPTIMIZATION; AWARE;
D O I
10.3390/app13032010
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
With the booming proliferation of user requests in the Internet of Things (IoT) network, Edge Computing (EC) is emerging as a promising paradigm for the provision of flexible and reliable services. Considering the resource constraints of IoT devices, for some delay-aware user requests, a heavy-workload IoT device may not respond on time. EC has sparked a popular wave of offloading user requests to edge servers at the edge of the network. The orchestration of user-requested offloading schemes creates a remarkable challenge regarding the delay in user requests and the energy consumption of IoT devices in edge networks. To solve this challenge, we propose a dynamic computation offloading strategy consisting of the following: (i) we propose the concept of intermediate nodes, which can minimize the delay in user requests and the energy consumption of the current tasks handled by IoT devices by dynamically combining task-offloading and service migration strategies; (ii) based on the workload of the current network, the intermediate node selection problem is modeled as a multi-dimensional Markov Decision Process (MDP) space, and a deep reinforcement learning algorithm is implemented to reduce the large MDP space and make a fast decision. Experimental results show that this strategy is superior to the existing baseline methods to reduce delays in user requests and the energy consumption of IoT devices.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] Dynamic Edge Computation Offloading for Internet of Vehicles With Deep Reinforcement Learning
    Yao, Liang
    Xu, Xiaolong
    Bilal, Muhammad
    Wang, Huihui
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (11) : 12991 - 12999
  • [2] Deep Reinforcement Learning and Game Theory for Computation Offloading in Dynamic Edge Computing Markets
    Li, Shuyang
    Hu, Xiaohui
    Du, Yongwen
    [J]. IEEE ACCESS, 2021, 9 : 121456 - 121466
  • [3] Computation Offloading in Edge Computing Based on Deep Reinforcement Learning
    Li, MingChu
    Mao, Ning
    Zheng, Xiao
    Gadekallu, Thippa Reddy
    [J]. PROCEEDINGS OF INTERNATIONAL CONFERENCE ON COMPUTING AND COMMUNICATION NETWORKS (ICCCN 2021), 2022, 394 : 339 - 353
  • [4] Computation offloading Optimization in Edge Computing based on Deep Reinforcement Learning
    Zhu Qinghua
    Chang Ying
    Zhao Jingya
    Liu Yong
    [J]. 2020 5TH INTERNATIONAL CONFERENCE ON MECHANICAL, CONTROL AND COMPUTER ENGINEERING (ICMCCE 2020), 2020, : 1552 - 1558
  • [5] Edge QoE: Computation Offloading With Deep Reinforcement Learning for Internet of Things
    Lu, Haodong
    He, Xiaoming
    Du, Miao
    Ruan, Xiukai
    Sun, Yanfei
    Wang, Kun
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (10): : 9255 - 9265
  • [6] Binary Computation Offloading in Edge Computing Using Deep Reinforcement Learning
    Rajwar, Dipankar
    Kumar, Dinesh
    [J]. ADVANCED NETWORK TECHNOLOGIES AND INTELLIGENT COMPUTING, ANTIC 2023, PT II, 2024, 2091 : 215 - 227
  • [7] Deep reinforcement learning for computation offloading in mobile edge computing environment
    Chen, Miaojiang
    Wang, Tian
    Zhang, Shaobo
    Liu, Anfeng
    [J]. COMPUTER COMMUNICATIONS, 2021, 175 : 1 - 12
  • [8] Federated Deep Reinforcement Learning for Joint AeBSs Deployment and Computation Offloading in Aerial Edge Computing Network
    Liu, Lei
    Zhao, Yikun
    Qi, Fei
    Zhou, Fanqin
    Xie, Weiliang
    He, Haoran
    Zheng, Hao
    [J]. ELECTRONICS, 2022, 11 (21)
  • [9] Deep Reinforcement Learning-Based Computation Offloading in Vehicular Edge Computing
    Zhan, Wenhan
    Luo, Chunbo
    Wang, Jin
    Min, Geyong
    Duan, Hancong
    [J]. 2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [10] Deep reinforcement learning for the computation offloading in MIMO-based Edge Computing
    Sadiki, Abdeladim
    Bentahar, Jamal
    Dssouli, Rachida
    En-Nouaary, Abdeslam
    Otrok, Hadi
    [J]. AD HOC NETWORKS, 2023, 141