Resource optimization for UAV-assisted mobile edge computing system based on deep reinforcement learning

被引:4
|
作者
Yu, Fan [1 ]
Yang, Dingcheng [1 ]
Wu, Fahui [1 ]
Wang, Yapeng [2 ]
He, Hao [3 ]
机构
[1] Nanchang Univ, Sch Informat Engn, Nanchang 330031, Peoples R China
[2] Macao Polytech Univ, Fac Appl Sci, Taipa, Macao, Peoples R China
[3] Jiangsu Univ Sci & technol, Ocean Coll, Zhenjiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Mobile edge computing(MEC); Deep reinforcement learning; Resource allocation; Trajectory optimization; Computation efficiency; COMPUTATION; ALLOCATION; MAXIMIZATION;
D O I
10.1016/j.phycom.2023.102107
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Computational efficiency is a direction worth considering in moving edge computing (MEC) systems. However, the computational efficiency of UAV-assisted MEC systems is rarely studied. In this paper, we maximize the computational efficiency of the MEC network by optimizing offloading decisions, UAV flight paths, and allocating users' charging and offloading time reasonably. The method of deep reinforcement learning is used to optimize the resources of UAV-assisted MEC system in complex urban environment, and the user's computation-intensive tasks are offloaded to the UAV-mounted MEC server, so that the overloaded tasks in the whole system can be alleviated. We study and design a framework algorithm that can quickly adapt to task offload decision making and resource allocation under changing wireless channel conditions in complex urban environments. The optimal offloading decisions from state space to action space is generated through deep reinforcement learning, and then the user's own charging time and offloading time are rationally allocated to maximize the weighted sum computation rate. Finally, combined with the radio map to optimize the UAC trajectory to improve the overall weighted sum computation rate of the system. Simulation results show that the proposed DRL+TO framework algorithm can significantly improve the weighted sum computation rate of the whole MEC system and save time. It can be seen that the MEC system resource optimization scheme proposed in this paper is feasible and has better performance than other benchmark schemes.(c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Joint Communication and Computation Resource Scheduling of a UAV-Assisted Mobile Edge Computing System for Platooning Vehicles
    Liu, Yang
    Zhou, Jianshan
    Tian, Daxin
    Sheng, Zhengguo
    Duan, Xuting
    Qu, Guixian
    Leung, Victor C. M.
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) : 8435 - 8450
  • [32] Joint Resource Allocation and Trajectory Design for UAV-assisted Mobile Edge Computing Systems
    Ji, Jiequ
    Zhu, Kun
    Yi, Changyan
    Wang, Ran
    Niyato, Dusit
    [J]. 2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [33] Joint Offloading and Resource Allocation of UAV-assisted Mobile Edge Computing with Delay Constraints
    Tan, Tiao
    Zhao, Ming
    Zhu, Yusen
    Zeng, Zhiwen
    [J]. 2021 IEEE 41ST INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS WORKSHOPS (ICDCSW 2021), 2021, : 21 - 26
  • [34] Evolutionary Multi-Objective Reinforcement Learning Based Trajectory Control and Task Offloading in UAV-Assisted Mobile Edge Computing
    Song, Fuhong
    Xing, Huanlai
    Wang, Xinhan
    Luo, Shouxi
    Dai, Penglin
    Xiao, Zhiwen
    Zhao, Bowen
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (12) : 7387 - 7405
  • [35] DeepMECagent: multi-agent computing resource allocation for UAV-assisted mobile edge computing in distributed IoT system
    Xiangxiang Zhang
    Yichao Wang
    [J]. Applied Intelligence, 2023, 53 : 1180 - 1191
  • [36] Joint resource optimization and trajectory design for energy minimization in UAV-assisted mobile-edge computing systems
    Zuo, Bangfu
    Xu, Yu
    Yang, Dingcheng
    Xiao, Lin
    Zhang, Tiankui
    [J]. COMPUTER COMMUNICATIONS, 2023, 203 : 312 - 323
  • [37] Deep Reinforcement Learning-Empowered Trajectory and Resource Allocation Optimization for UAV-Assisted MEC Systems
    Sun, Haowen
    Chen, Ming
    Pan, Yijin
    Cang, Yihan
    Zhao, Jiahui
    Sun, Yuanzhi
    [J]. IEEE WIRELESS COMMUNICATIONS LETTERS, 2024, 13 (07) : 1823 - 1827
  • [38] DeepMECagent: multi-agent computing resource allocation for UAV-assisted mobile edge computing in distributed IoT system
    Zhang, Xiangxiang
    Wang, Yichao
    [J]. APPLIED INTELLIGENCE, 2023, 53 (01) : 1180 - 1191
  • [39] A Mobile Edge Computing Framework for Task Offloading and Resource Allocation in UAV-assisted VANETs
    He, Yixin
    Zhai, Daosen
    Zhang, Ruonan
    Du, Jianbo
    Aujla, Gagangeet Singh
    Cao, Haotong
    [J]. IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (IEEE INFOCOM WKSHPS 2021), 2021,
  • [40] Joint Placement and Resource Allocation for UAV-Assisted Mobile Edge Computing Networks with URLLC
    ZHANG Pengyu
    XIE Lifeng
    XU Jie
    [J]. ZTE Communications, 2020, 18 (02) : 49 - 56