Resource optimization for UAV-assisted mobile edge computing system based on deep reinforcement learning

被引:4
|
作者
Yu, Fan [1 ]
Yang, Dingcheng [1 ]
Wu, Fahui [1 ]
Wang, Yapeng [2 ]
He, Hao [3 ]
机构
[1] Nanchang Univ, Sch Informat Engn, Nanchang 330031, Peoples R China
[2] Macao Polytech Univ, Fac Appl Sci, Taipa, Macao, Peoples R China
[3] Jiangsu Univ Sci & technol, Ocean Coll, Zhenjiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Mobile edge computing(MEC); Deep reinforcement learning; Resource allocation; Trajectory optimization; Computation efficiency; COMPUTATION; ALLOCATION; MAXIMIZATION;
D O I
10.1016/j.phycom.2023.102107
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Computational efficiency is a direction worth considering in moving edge computing (MEC) systems. However, the computational efficiency of UAV-assisted MEC systems is rarely studied. In this paper, we maximize the computational efficiency of the MEC network by optimizing offloading decisions, UAV flight paths, and allocating users' charging and offloading time reasonably. The method of deep reinforcement learning is used to optimize the resources of UAV-assisted MEC system in complex urban environment, and the user's computation-intensive tasks are offloaded to the UAV-mounted MEC server, so that the overloaded tasks in the whole system can be alleviated. We study and design a framework algorithm that can quickly adapt to task offload decision making and resource allocation under changing wireless channel conditions in complex urban environments. The optimal offloading decisions from state space to action space is generated through deep reinforcement learning, and then the user's own charging time and offloading time are rationally allocated to maximize the weighted sum computation rate. Finally, combined with the radio map to optimize the UAC trajectory to improve the overall weighted sum computation rate of the system. Simulation results show that the proposed DRL+TO framework algorithm can significantly improve the weighted sum computation rate of the whole MEC system and save time. It can be seen that the MEC system resource optimization scheme proposed in this paper is feasible and has better performance than other benchmark schemes.(c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Deep Reinforcement Learning Based Secure Transmission for UAV-Assisted Mobile Edge Computing
    Vijayalakshmi, N.
    Gulati, Sagar
    Sujin, B. Ben
    Rao, B. Madhav
    Kumar, K. Kiran
    [J]. International Journal of Interactive Mobile Technologies, 2024, 18 (17) : 154 - 169
  • [2] Deep Reinforcement Learning Approach for UAV-Assisted Mobile Edge Computing Networks
    Hwang, Sangwon
    Park, Juseong
    Lee, Hoon
    Kim, Mintae
    Lee, Inkyu
    [J]. 2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 3839 - 3844
  • [3] Deep Reinforcement Learning Based Dynamic Trajectory Control for UAV-Assisted Mobile Edge Computing
    Wang, Liang
    Wang, Kezhi
    Pan, Cunhua
    Xu, Wei
    Aslam, Nauman
    Nallanathan, Arumugam
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2022, 21 (10) : 3536 - 3550
  • [4] Deep Reinforcement Learning Driven UAV-Assisted Edge Computing
    Zhang, Liang
    Jabbari, Bijan
    Ansari, Nirwan
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (24) : 25449 - 25459
  • [5] Deep Reinforcement Learning Based Computation Offloading in UAV-Assisted Edge Computing
    Zhang, Peiying
    Su, Yu
    Li, Boxiao
    Liu, Lei
    Wang, Cong
    Zhang, Wei
    Tan, Lizhuang
    [J]. DRONES, 2023, 7 (03)
  • [6] Deep Reinforcement Learning-Based Online Resource Management for UAV-Assisted Edge Computing With Dual Connectivity
    Hoang, Linh T. T.
    Nguyen, Chuyen T. T.
    Pham, Anh T. T.
    [J]. IEEE-ACM TRANSACTIONS ON NETWORKING, 2023, 31 (06) : 2761 - 2776
  • [7] Deep Reinforcement Learning based Path Planning for UAV-assisted Edge Computing Networks
    Peng, Yingsheng
    Liu, Yong
    Zhang, Han
    [J]. 2021 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2021,
  • [8] Task Offloading and Trajectory Control for UAV-Assisted Mobile Edge Computing Using Deep Reinforcement Learning
    Zhang, Lu
    Zhang, Zi-Yan
    Min, Luo
    Tang, Chao
    Zhang, Hong-Ying
    Wang, Ya-Hong
    Cai, Peng
    [J]. IEEE ACCESS, 2021, 9 : 53708 - 53719
  • [9] Multi-Agent Deep Reinforcement Learning for Task Offloading in UAV-Assisted Mobile Edge Computing
    Zhao, Nan
    Ye, Zhiyang
    Pei, Yiyang
    Liang, Ying-Chang
    Niyato, Dusit
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (09) : 6949 - 6960
  • [10] Resource Allocation and Trajectory Optimization in OTFS-Based UAV-Assisted Mobile Edge Computing
    Li, Wei
    Guo, Yan
    Li, Ning
    Yuan, Hao
    Liu, Cuntao
    [J]. ELECTRONICS, 2023, 12 (10)