Task Offloading and Trajectory Control for UAV-Assisted Mobile Edge Computing Using Deep Reinforcement Learning

被引:58
|
作者
Zhang, Lu [1 ,2 ,3 ]
Zhang, Zi-Yan [1 ,2 ,3 ]
Min, Luo [5 ]
Tang, Chao [1 ,2 ,3 ]
Zhang, Hong-Ying [1 ,2 ,3 ]
Wang, Ya-Hong [1 ,2 ,3 ]
Cai, Peng [1 ,2 ,3 ,4 ]
机构
[1] Chinese Acad Sci, Inst Urban Environm, Key Lab Urban Environm & Hlth, Xiamen 361021, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Xiamen Key Lab Phys Environm, Xiamen 361021, Peoples R China
[4] Chinese Acad Sci, Shanghai Inst Nutr & Hlth, Shanghai 200031, Peoples R China
[5] Univ Elect Sci & Technol China, State Key Lab Elect Thin Films & Integrated Devic, Chengdu 610054, Peoples R China
关键词
Task analysis; Computational modeling; Servers; Energy consumption; Trajectory; Reinforcement learning; Unmanned aerial vehicles; Computation offloading; deep learning; energy saving; mobile edge computing; reinforcement learning; unmanned aerial vehicle; RESOURCE-ALLOCATION; INTERNET;
D O I
10.1109/ACCESS.2021.3070908
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Mobile Edge Computing (MEC) has been widely employed to support various Internet of Things (IoT) and mobile applications. By leveraging the advantages of easily deployed and flexibility of Unmanned Aerial Vehicle (UAV), one of MEC primary functions is employing UAVs equipped with MEC servers to provide computation supports for the offloaded tasks by mobile users in temporally hotspot areas or some emergent scenarios, such as sports game areas or destroyed by natural disaster areas. Despite the numerous advantages of UAV carried with a MEC server, it is restricted by its limited computation resources and sensitive energy consumption. Moreover, due to the complexity of UAV-assisted MEC system, its computational resource optimization and energy consumption optimization cannot be achieved well in traditional optimization methods. Furthermore, the computational cost of the MEC system optimization is often exponentially growing with the increase of the MEC servers and mobile users. Therefore, it is considerably challenging to control the UAV positions and schedule the task offloading ratio. In this paper, we proposed a novel Deep Reinforcement Learning (DRL) method to optimize UAV trajectory controlling and users' offloaded task ratio scheduling and improve the performance of the UAV-assisted MEC system. We maximized the system stability and minimized the energy consumption and computation latency of UAV-assisted the MEC system. The simulation results show that the proposed method outperforms existing work and has better scalability.
引用
下载
收藏
页码:53708 / 53719
页数:12
相关论文
共 50 条
  • [41] Online Incentive Mechanism for Task Offloading with Privacy-Preserving in UAV-assisted Mobile Edge Computing
    Zhou, Ruiting
    Zhang, Renli
    Wang, Yufeng
    Tan, Haisheng
    He, Kun
    PROCEEDINGS OF THE 2022 THE TWENTY-THIRD INTERNATIONAL SYMPOSIUM ON THEORY, ALGORITHMIC FOUNDATIONS, AND PROTOCOL DESIGN FOR MOBILE NETWORKS AND MOBILE COMPUTING, MOBIHOC 2022, 2022, : 211 - 220
  • [42] Deep Reinforcement Learning-Based Resource Management for UAV-Assisted Mobile Edge Computing Against Jamming
    Shao, Ziling
    Yang, Helin
    Xiao, Liang
    Su, Wei
    Chen, Yifan
    Xiong, Zehui
    IEEE Transactions on Mobile Computing, 2024, 23 (12) : 13358 - 13374
  • [43] Deep Reinforcement Learning based Path Planning for UAV-assisted Edge Computing Networks
    Peng, Yingsheng
    Liu, Yong
    Zhang, Han
    2021 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2021,
  • [44] An UAV-assisted mobile edge computing offloading strategy for minimizing energy consumption
    Tang, Qiang
    Liu, Lixin
    Jin, Caiyan
    Wang, Jin
    Liao, Zhuofan
    Luo, Yuansheng
    COMPUTER NETWORKS, 2022, 207
  • [45] UAV-assisted cooperative offloading energy efficiency system for mobile edge computing
    XueYong Yu
    WenJin Niu
    Ye Zhu
    HongBo Zhu
    Digital Communications and Networks, 2024, 10 (01) : 16 - 24
  • [46] Joint Offloading and Resource Allocation Based on UAV-Assisted Mobile Edge Computing
    Tan, Tiao
    Zhao, Ming
    Zeng, Zhiwen
    ACM TRANSACTIONS ON SENSOR NETWORKS, 2022, 18 (03)
  • [47] UAV-assisted cooperative offloading energy efficiency system for mobile edge computing
    Yu, Xue-Yong
    Niu, Wen-Jin
    Zhu, Ye
    Zhu, Hong-Bo
    DIGITAL COMMUNICATIONS AND NETWORKS, 2024, 10 (01) : 16 - 24
  • [48] Computation offloading optimization for UAV-assisted mobile edge computing: a deep deterministic policy gradient approach
    Yunpeng Wang
    Weiwei Fang
    Yi Ding
    Naixue Xiong
    Wireless Networks, 2021, 27 : 2991 - 3006
  • [49] Deep Reinforcement Learning and Markov Decision Problem for Task Offloading in Mobile Edge Computing
    Gao, Xiaohu
    Ang, Mei Choo
    Althubiti, Sara A.
    JOURNAL OF GRID COMPUTING, 2023, 21 (04)
  • [50] Computation offloading optimization for UAV-assisted mobile edge computing: a deep deterministic policy gradient approach
    Wang, Yunpeng
    Fang, Weiwei
    Ding, Yi
    Xiong, Naixue
    WIRELESS NETWORKS, 2021, 27 (04) : 2991 - 3006