Task Offloading and Trajectory Control for UAV-Assisted Mobile Edge Computing Using Deep Reinforcement Learning

被引:70
|
作者
Zhang, Lu [1 ,2 ,3 ]
Zhang, Zi-Yan [1 ,2 ,3 ]
Min, Luo [5 ]
Tang, Chao [1 ,2 ,3 ]
Zhang, Hong-Ying [1 ,2 ,3 ]
Wang, Ya-Hong [1 ,2 ,3 ]
Cai, Peng [1 ,2 ,3 ,4 ]
机构
[1] Chinese Acad Sci, Inst Urban Environm, Key Lab Urban Environm & Hlth, Xiamen 361021, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Xiamen Key Lab Phys Environm, Xiamen 361021, Peoples R China
[4] Chinese Acad Sci, Shanghai Inst Nutr & Hlth, Shanghai 200031, Peoples R China
[5] Univ Elect Sci & Technol China, State Key Lab Elect Thin Films & Integrated Devic, Chengdu 610054, Peoples R China
关键词
Task analysis; Computational modeling; Servers; Energy consumption; Trajectory; Reinforcement learning; Unmanned aerial vehicles; Computation offloading; deep learning; energy saving; mobile edge computing; reinforcement learning; unmanned aerial vehicle; RESOURCE-ALLOCATION; INTERNET;
D O I
10.1109/ACCESS.2021.3070908
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Mobile Edge Computing (MEC) has been widely employed to support various Internet of Things (IoT) and mobile applications. By leveraging the advantages of easily deployed and flexibility of Unmanned Aerial Vehicle (UAV), one of MEC primary functions is employing UAVs equipped with MEC servers to provide computation supports for the offloaded tasks by mobile users in temporally hotspot areas or some emergent scenarios, such as sports game areas or destroyed by natural disaster areas. Despite the numerous advantages of UAV carried with a MEC server, it is restricted by its limited computation resources and sensitive energy consumption. Moreover, due to the complexity of UAV-assisted MEC system, its computational resource optimization and energy consumption optimization cannot be achieved well in traditional optimization methods. Furthermore, the computational cost of the MEC system optimization is often exponentially growing with the increase of the MEC servers and mobile users. Therefore, it is considerably challenging to control the UAV positions and schedule the task offloading ratio. In this paper, we proposed a novel Deep Reinforcement Learning (DRL) method to optimize UAV trajectory controlling and users' offloaded task ratio scheduling and improve the performance of the UAV-assisted MEC system. We maximized the system stability and minimized the energy consumption and computation latency of UAV-assisted the MEC system. The simulation results show that the proposed method outperforms existing work and has better scalability.
引用
收藏
页码:53708 / 53719
页数:12
相关论文
共 50 条
  • [1] Computation Offloading and Trajectory Control for UAV-Assisted Edge Computing Using Deep Reinforcement Learning
    Qi, Huamei
    Zhou, Zheng
    APPLIED SCIENCES-BASEL, 2022, 12 (24):
  • [2] Task Offloading and Trajectory Optimization for UAV-Assisted Mobile Edge Computing
    Shi, Mengmeng
    Xing, Yanchao
    Guo, Xueli
    Zhu, Xuerui
    Zhu, Ziyao
    Zhou, Jiaqi
    2024 INTERNATIONAL CONFERENCE ON UBIQUITOUS COMMUNICATION, UCOM 2024, 2024, : 432 - 437
  • [3] Multi-Agent Deep Reinforcement Learning for Task Offloading in UAV-Assisted Mobile Edge Computing
    Zhao, Nan
    Ye, Zhiyang
    Pei, Yiyang
    Liang, Ying-Chang
    Niyato, Dusit
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (09) : 6949 - 6960
  • [4] Evolutionary Multi-Objective Reinforcement Learning Based Trajectory Control and Task Offloading in UAV-Assisted Mobile Edge Computing
    Song, Fuhong
    Xing, Huanlai
    Wang, Xinhan
    Luo, Shouxi
    Dai, Penglin
    Xiao, Zhiwen
    Zhao, Bowen
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (12) : 7387 - 7405
  • [5] Deep Reinforcement Learning Based Dynamic Trajectory Control for UAV-Assisted Mobile Edge Computing
    Wang, Liang
    Wang, Kezhi
    Pan, Cunhua
    Xu, Wei
    Aslam, Nauman
    Nallanathan, Arumugam
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2022, 21 (10) : 3536 - 3550
  • [6] Joint Trajectory Optimization and Task Offloading for UAV-Assisted Mobile Edge Computing
    Wang, Yipeng
    Liu, Yiming
    Zhang, Jiaxiang
    Liu, Baoling
    2023 IEEE 34TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS, PIMRC, 2023,
  • [7] Deep Reinforcement Learning Based Computation Offloading in UAV-Assisted Edge Computing
    Zhang, Peiying
    Su, Yu
    Li, Boxiao
    Liu, Lei
    Wang, Cong
    Zhang, Wei
    Tan, Lizhuang
    DRONES, 2023, 7 (03)
  • [8] Edge Computing Task Offloading Optimization for a UAV-Assisted Internet of Vehicles via Deep Reinforcement Learning
    Yan, Ming
    Xiong, Rui
    Wang, Yan
    Li, Chunguo
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (04) : 5647 - 5658
  • [9] Deep Reinforcement Learning for Scheduling and Offloading in UAV-Assisted Mobile Edge Networks
    Tian X.
    Miao P.
    Zhang L.
    Wireless Communications and Mobile Computing, 2023, 2023
  • [10] UAV-Assisted Task Offloading in Edge Computing
    Zhang, Junna
    Zhang, Guoxian
    Wang, Xinxin
    Zhao, Xiaoyan
    Yuan, Peiyan
    Jin, Hu
    IEEE INTERNET OF THINGS JOURNAL, 2025, 12 (05): : 5559 - 5574