Task Offloading and Trajectory Control for UAV-Assisted Mobile Edge Computing Using Deep Reinforcement Learning

被引:58
|
作者
Zhang, Lu [1 ,2 ,3 ]
Zhang, Zi-Yan [1 ,2 ,3 ]
Min, Luo [5 ]
Tang, Chao [1 ,2 ,3 ]
Zhang, Hong-Ying [1 ,2 ,3 ]
Wang, Ya-Hong [1 ,2 ,3 ]
Cai, Peng [1 ,2 ,3 ,4 ]
机构
[1] Chinese Acad Sci, Inst Urban Environm, Key Lab Urban Environm & Hlth, Xiamen 361021, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Xiamen Key Lab Phys Environm, Xiamen 361021, Peoples R China
[4] Chinese Acad Sci, Shanghai Inst Nutr & Hlth, Shanghai 200031, Peoples R China
[5] Univ Elect Sci & Technol China, State Key Lab Elect Thin Films & Integrated Devic, Chengdu 610054, Peoples R China
关键词
Task analysis; Computational modeling; Servers; Energy consumption; Trajectory; Reinforcement learning; Unmanned aerial vehicles; Computation offloading; deep learning; energy saving; mobile edge computing; reinforcement learning; unmanned aerial vehicle; RESOURCE-ALLOCATION; INTERNET;
D O I
10.1109/ACCESS.2021.3070908
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Mobile Edge Computing (MEC) has been widely employed to support various Internet of Things (IoT) and mobile applications. By leveraging the advantages of easily deployed and flexibility of Unmanned Aerial Vehicle (UAV), one of MEC primary functions is employing UAVs equipped with MEC servers to provide computation supports for the offloaded tasks by mobile users in temporally hotspot areas or some emergent scenarios, such as sports game areas or destroyed by natural disaster areas. Despite the numerous advantages of UAV carried with a MEC server, it is restricted by its limited computation resources and sensitive energy consumption. Moreover, due to the complexity of UAV-assisted MEC system, its computational resource optimization and energy consumption optimization cannot be achieved well in traditional optimization methods. Furthermore, the computational cost of the MEC system optimization is often exponentially growing with the increase of the MEC servers and mobile users. Therefore, it is considerably challenging to control the UAV positions and schedule the task offloading ratio. In this paper, we proposed a novel Deep Reinforcement Learning (DRL) method to optimize UAV trajectory controlling and users' offloaded task ratio scheduling and improve the performance of the UAV-assisted MEC system. We maximized the system stability and minimized the energy consumption and computation latency of UAV-assisted the MEC system. The simulation results show that the proposed method outperforms existing work and has better scalability.
引用
收藏
页码:53708 / 53719
页数:12
相关论文
共 50 条
  • [21] Deep-Reinforcement-Learning-Based Computation Offloading in UAV-Assisted Vehicular Edge Computing Networks
    Yan, Junjie
    Zhao, Xiaohui
    Li, Zan
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (11): : 19882 - 19897
  • [22] UAV-Assisted Task Offloading in Vehicular Edge Computing Networks
    Dai, Xingxia
    Xiao, Zhu
    Jiang, Hongbo
    Lui, John C. S.
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (04) : 2520 - 2534
  • [23] Task Offloading and Energy Optimization in Hybrid UAV-Assisted Mobile Edge Computing Systems
    Gao, Ang
    Zhang, Shuai
    Zhang, Qian
    Hu, Yansu
    Liu, Shuhua
    Liang, Wei
    Ng, Soon Xin
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (08) : 12052 - 12066
  • [24] A Mobile Edge Computing Framework for Task Offloading and Resource Allocation in UAV-assisted VANETs
    He, Yixin
    Zhai, Daosen
    Zhang, Ruonan
    Du, Jianbo
    Aujla, Gagangeet Singh
    Cao, Haotong
    IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (IEEE INFOCOM WKSHPS 2021), 2021,
  • [25] Resource optimization for UAV-assisted mobile edge computing system based on deep reinforcement learning
    Yu, Fan
    Yang, Dingcheng
    Wu, Fahui
    Wang, Yapeng
    He, Hao
    PHYSICAL COMMUNICATION, 2023, 59
  • [26] Deep Reinforcement Learning for Task Offloading in Mobile Edge Computing Systems
    Tang, Ming
    Wong, Vincent W. S.
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2022, 21 (06) : 1985 - 1997
  • [27] Joint Computation Offloading and Trajectory Planning for UAV-Assisted Edge Computing
    Sun, Chao
    Ni, Wei
    Wang, Xin
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (08) : 5343 - 5358
  • [28] UAV-Assisted Wireless Powered Cooperative Mobile Edge Computing: Joint Offloading, CPU Control, and Trajectory Optimization
    Liu, Yuan
    Xiong, Ke
    Ni, Qiang
    Fan, Pingyi
    Ben Letaief, Khaled
    IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (04) : 2777 - 2790
  • [29] Computation Offloading and Trajectory Design for UAV-assisted Mobile Computing Systems
    Sun, Chao
    Ni, Wei
    Wang, Xin
    2020 12TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP), 2020, : 528 - 533
  • [30] Deep Reinforcement Learning for Task Offloading and Power Allocation in UAV-Assisted MEC System
    Zhao, Nan
    Ren, Fan
    Du, Wei
    Ye, Zhiyang
    INTERNATIONAL JOURNAL OF MOBILE COMPUTING AND MULTIMEDIA COMMUNICATIONS, 2021, 12 (04) : 32 - 51