Task Offloading and Trajectory Control for UAV-Assisted Mobile Edge Computing Using Deep Reinforcement Learning

被引:58
|
作者
Zhang, Lu [1 ,2 ,3 ]
Zhang, Zi-Yan [1 ,2 ,3 ]
Min, Luo [5 ]
Tang, Chao [1 ,2 ,3 ]
Zhang, Hong-Ying [1 ,2 ,3 ]
Wang, Ya-Hong [1 ,2 ,3 ]
Cai, Peng [1 ,2 ,3 ,4 ]
机构
[1] Chinese Acad Sci, Inst Urban Environm, Key Lab Urban Environm & Hlth, Xiamen 361021, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Xiamen Key Lab Phys Environm, Xiamen 361021, Peoples R China
[4] Chinese Acad Sci, Shanghai Inst Nutr & Hlth, Shanghai 200031, Peoples R China
[5] Univ Elect Sci & Technol China, State Key Lab Elect Thin Films & Integrated Devic, Chengdu 610054, Peoples R China
关键词
Task analysis; Computational modeling; Servers; Energy consumption; Trajectory; Reinforcement learning; Unmanned aerial vehicles; Computation offloading; deep learning; energy saving; mobile edge computing; reinforcement learning; unmanned aerial vehicle; RESOURCE-ALLOCATION; INTERNET;
D O I
10.1109/ACCESS.2021.3070908
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Mobile Edge Computing (MEC) has been widely employed to support various Internet of Things (IoT) and mobile applications. By leveraging the advantages of easily deployed and flexibility of Unmanned Aerial Vehicle (UAV), one of MEC primary functions is employing UAVs equipped with MEC servers to provide computation supports for the offloaded tasks by mobile users in temporally hotspot areas or some emergent scenarios, such as sports game areas or destroyed by natural disaster areas. Despite the numerous advantages of UAV carried with a MEC server, it is restricted by its limited computation resources and sensitive energy consumption. Moreover, due to the complexity of UAV-assisted MEC system, its computational resource optimization and energy consumption optimization cannot be achieved well in traditional optimization methods. Furthermore, the computational cost of the MEC system optimization is often exponentially growing with the increase of the MEC servers and mobile users. Therefore, it is considerably challenging to control the UAV positions and schedule the task offloading ratio. In this paper, we proposed a novel Deep Reinforcement Learning (DRL) method to optimize UAV trajectory controlling and users' offloaded task ratio scheduling and improve the performance of the UAV-assisted MEC system. We maximized the system stability and minimized the energy consumption and computation latency of UAV-assisted the MEC system. The simulation results show that the proposed method outperforms existing work and has better scalability.
引用
收藏
页码:53708 / 53719
页数:12
相关论文
共 50 条
  • [1] Computation Offloading and Trajectory Control for UAV-Assisted Edge Computing Using Deep Reinforcement Learning
    Qi, Huamei
    Zhou, Zheng
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (24):
  • [2] Multi-Agent Deep Reinforcement Learning for Task Offloading in UAV-Assisted Mobile Edge Computing
    Zhao, Nan
    Ye, Zhiyang
    Pei, Yiyang
    Liang, Ying-Chang
    Niyato, Dusit
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (09) : 6949 - 6960
  • [3] Evolutionary Multi-Objective Reinforcement Learning Based Trajectory Control and Task Offloading in UAV-Assisted Mobile Edge Computing
    Song, Fuhong
    Xing, Huanlai
    Wang, Xinhan
    Luo, Shouxi
    Dai, Penglin
    Xiao, Zhiwen
    Zhao, Bowen
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (12) : 7387 - 7405
  • [4] Deep Reinforcement Learning Based Dynamic Trajectory Control for UAV-Assisted Mobile Edge Computing
    Wang, Liang
    Wang, Kezhi
    Pan, Cunhua
    Xu, Wei
    Aslam, Nauman
    Nallanathan, Arumugam
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2022, 21 (10) : 3536 - 3550
  • [5] Joint Trajectory Optimization and Task Offloading for UAV-Assisted Mobile Edge Computing
    Wang, Yipeng
    Liu, Yiming
    Zhang, Jiaxiang
    Liu, Baoling
    [J]. 2023 IEEE 34TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS, PIMRC, 2023,
  • [6] Deep Reinforcement Learning Based Computation Offloading in UAV-Assisted Edge Computing
    Zhang, Peiying
    Su, Yu
    Li, Boxiao
    Liu, Lei
    Wang, Cong
    Zhang, Wei
    Tan, Lizhuang
    [J]. DRONES, 2023, 7 (03)
  • [7] Edge Computing Task Offloading Optimization for a UAV-Assisted Internet of Vehicles via Deep Reinforcement Learning
    Yan, Ming
    Xiong, Rui
    Wang, Yan
    Li, Chunguo
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (04) : 5647 - 5658
  • [8] Deep Reinforcement Learning for Scheduling and Offloading in UAV-Assisted Mobile Edge Networks
    Tian X.
    Miao P.
    Zhang L.
    [J]. Wireless Communications and Mobile Computing, 2023, 2023
  • [9] Deep Reinforcement Learning for Multi-Hop Offloading in UAV-Assisted Edge Computing
    Nguyen Tien Hoa
    Do Van Dai
    Le Hoang Lan
    Nguyen Cong Luong
    Duc Van Le
    Niyato, Dusit
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (12) : 16917 - 16922
  • [10] Deep Reinforcement Learning Approach for UAV-Assisted Mobile Edge Computing Networks
    Hwang, Sangwon
    Park, Juseong
    Lee, Hoon
    Kim, Mintae
    Lee, Inkyu
    [J]. 2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 3839 - 3844