Deep Reinforcement Learning Based Computation Offloading in UAV-Assisted Edge Computing

被引:8
|
作者
Zhang, Peiying [1 ,2 ]
Su, Yu [1 ]
Li, Boxiao [3 ,4 ]
Liu, Lei [2 ,5 ]
Wang, Cong [6 ]
Zhang, Wei [7 ]
Tan, Lizhuang [7 ]
机构
[1] China Univ Petr East China, Qingdao Inst Software, Coll Comp Sci & Technol, Qingdao 266580, Peoples R China
[2] Xidian Univ, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[3] Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China
[4] China Acad Elect & Informat Technol, Beijing 100041, Peoples R China
[5] Xidian Univ, Xidian Guangzhou Inst Technol, Guangzhou 510555, Peoples R China
[6] Northeastern Univ Qinhuangdao, Sch Comp & Commun Engn, Qinhuangdao 066004, Peoples R China
[7] Qilu Univ Technol, Shandong Acad Sci, Shandong Comp Sci Ctr, Natl Supercomp Ctr Jinan,Shandong Prov Key Lab Com, Jinan 250013, Peoples R China
关键词
multi-access edge computing; deep reinforcement learning; computation offloading; MOBILE; OPTIMIZATION; INTERNET;
D O I
10.3390/drones7030213
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Traditional multi-access edge computing (MEC) often has difficulty processing large amounts of data in the face of high computationally intensive tasks, so it needs to offload policies to offload computation tasks to adjacent edge servers. The computation offloading problem is a mixed integer programming non-convex problem, and it is difficult to have a good solution. Meanwihle, the cost of deploying servers is often high when providing edge computing services in remote areas or some complex terrains. In this paper, the unmanned aerial vehicle (UAV) is introduced into the multi-access edge computing network, and a computation offloading method based on deep reinforcement learning in UAV-assisted multi-access edge computing network (DRCOM) is proposed. We use the UAV as the space base station of MEC, and it transforms computation task offloading problems of MEC into two sub-problems: find the optimal solution of whether each user's device is offloaded through deep reinforcement learning; allocate resources. We compared our algorithm with other three offloading methods, i.e., LC, CO, and LRA. The maximum computation rate of our algorithm DRCOM is 142.38% higher than LC, 50.37% higher than CO, and 12.44% higher than LRA. The experimental results demonstrate that DRCOM greatly improves the computation rate.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Deep-Reinforcement-Learning-Based Computation Offloading in UAV-Assisted Vehicular Edge Computing Networks
    Yan, Junjie
    Zhao, Xiaohui
    Li, Zan
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (11): : 19882 - 19897
  • [2] Computation Offloading and Trajectory Control for UAV-Assisted Edge Computing Using Deep Reinforcement Learning
    Qi, Huamei
    Zhou, Zheng
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (24):
  • [3] Deep Reinforcement Learning for Multi-Hop Offloading in UAV-Assisted Edge Computing
    Nguyen Tien Hoa
    Do Van Dai
    Le Hoang Lan
    Nguyen Cong Luong
    Duc Van Le
    Niyato, Dusit
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (12) : 16917 - 16922
  • [4] Multi-objective deep reinforcement learning for computation offloading in UAV-assisted multi-access edge computing ✩
    Liu, Xu
    Chai, Zheng-Yi
    Li, Ya-Lun
    Cheng, Yan-Yang
    Zeng, Yue
    [J]. INFORMATION SCIENCES, 2023, 642
  • [5] Deep Reinforcement Learning Driven UAV-Assisted Edge Computing
    Zhang, Liang
    Jabbari, Bijan
    Ansari, Nirwan
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (24) : 25449 - 25459
  • [6] Multi-Agent Deep Reinforcement Learning for Task Offloading in UAV-Assisted Mobile Edge Computing
    Zhao, Nan
    Ye, Zhiyang
    Pei, Yiyang
    Liang, Ying-Chang
    Niyato, Dusit
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (09) : 6949 - 6960
  • [7] Task Offloading and Trajectory Control for UAV-Assisted Mobile Edge Computing Using Deep Reinforcement Learning
    Zhang, Lu
    Zhang, Zi-Yan
    Min, Luo
    Tang, Chao
    Zhang, Hong-Ying
    Wang, Ya-Hong
    Cai, Peng
    [J]. IEEE ACCESS, 2021, 9 : 53708 - 53719
  • [8] Edge Computing Task Offloading Optimization for a UAV-Assisted Internet of Vehicles via Deep Reinforcement Learning
    Yan, Ming
    Xiong, Rui
    Wang, Yan
    Li, Chunguo
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (04) : 5647 - 5658
  • [9] Deep Reinforcement Learning for Scheduling and Offloading in UAV-Assisted Mobile Edge Networks
    Tian, Xianzhong
    Miao, Pingting
    Zhang, Luoming
    [J]. Wireless Communications and Mobile Computing, 2023, 2023
  • [10] Deep reinforcement learning based computation offloading for xURLLC services with UAV-assisted IoT-based multi-access edge computing system
    Fatima, Nida
    Saxena, Paresh
    Giambene, Giovanni
    [J]. WIRELESS NETWORKS, 2023,