Robust Computation Offloading and Trajectory Optimization for Multi-UAV-Assisted MEC: A Multiagent DRL Approach

被引:11
|
作者
Li, Bin [1 ,2 ]
Yang, Rongrong [1 ,2 ]
Liu, Lei [3 ]
Wang, Junyi [4 ]
Zhang, Ning [5 ]
Dong, Mianxiong [6 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Jiangsu Collaborat Innovat Ctr Atmospher Environm, Sch Comp & Software, Nanjing 210044, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Key Lab Broadband Wireless Commun & Sensor Network, Minist Educ, Nanjing 210003, Peoples R China
[3] Xidian Univ, Guangzhou Inst Technol, Guangzhou 510555, Peoples R China
[4] Guilin Univ Elect Technol, Sch Informat & Commun, Guilin 541004, Peoples R China
[5] Univ Windsor, Dept Elect & Comp Engn, Windsor, ON N9B 3P4, Canada
[6] Muroran Inst Technol, Dept Sci & Informat, Muroran 0508585, Japan
基金
中国国家自然科学基金;
关键词
Communication uncertainty; computation uncertainty; mobile-edge computing (MEC); multiagent deep reinforcement learning (MADRL); robust design; RESOURCE-ALLOCATION; EDGE; COMMUNICATION;
D O I
10.1109/JIOT.2023.3300718
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
For multiple unmanned-aerial-vehicles (UAVs)-assisted mobile-edge computing (MEC) networks, we study the problem of combined computation and communication for user equipments deployed with multitype tasks. Specifically, we consider that the MEC network encompasses both communication and computation uncertainties, where the partial channel state information and the inaccurate estimation of task complexity are only available. We introduce a robust design accounting for these uncertainties and minimize the total weighted energy consumption by jointly optimizing UAV trajectory, task partition, as well as the computation and communication resource allocation in the multi-UAV scenario. The formulated problem is challenging to solve with the coupled optimization variables and the high uncertainties. To overcome this issue, we reformulate a multiagent Markov decision process and propose a multiagent proximal policy optimization with Beta distribution framework to achieve a flexible learning policy. Numerical results demonstrate the effectiveness and robustness of the proposed algorithm for the multi-UAV-assisted MEC network, which outperforms the representative benchmarks of the deep reinforcement learning and heuristic algorithms.
引用
收藏
页码:4775 / 4786
页数:12
相关论文
共 50 条
  • [1] Computation Offloading and Trajectory Planning of Multi-UAV-Enabled MEC: A Knowledge-Assisted Multiagent Reinforcement Learning Approach
    Li, Xulong
    Qin, Yunhui
    Huo, Jiahao
    Wei, Huangfu
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (05) : 7077 - 7088
  • [2] Toward Optimal Resource Allocation: A Multi-Agent DRL Based Task Offloading Approach in Multi-UAV-Assisted MEC Networks
    Tariq, Muhammad Naqqash
    Wang, Jingyu
    Raza, Salman
    Siraj, Mohammad
    Altamimi, Majid
    Memon, Saifullah
    [J]. IEEE ACCESS, 2024, 12 : 81428 - 81440
  • [3] An evolutionary trajectory planning algorithm for multi-UAV-assisted MEC system
    Muhammad Asim
    Wali Khan Mashwani
    Habib Shah
    Samir Brahim Belhaouari
    [J]. Soft Computing, 2022, 26 : 7479 - 7492
  • [4] An evolutionary trajectory planning algorithm for multi-UAV-assisted MEC system
    Asim, Muhammad
    Mashwani, Wali Khan
    Shah, Habib
    Belhaouari, Samir Brahim
    [J]. SOFT COMPUTING, 2022, 26 (16) : 7479 - 7492
  • [5] Collaborative computation offloading and wireless charging scheduling in multi-UAV-assisted MEC networks: A TD3-based approach
    Zhao, Liang
    Yao, Yujun
    Guo, Jianmeng
    Zuo, Qingjun
    Leung, Victor C. M.
    [J]. COMPUTER NETWORKS, 2024, 251
  • [6] TD3-based Collaborative Computation Offloading and Charging Scheduling in Multi-UAV-Assisted MEC Networks
    Zhao, Liang
    Yao, Yujun
    Zhou, Huan
    Wang, Hao
    Leung, Victor C. M.
    [J]. 2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,
  • [7] Energy and Latency Efficient Joint Communication and Computation Optimization in a Multi-UAV-Assisted MEC Network
    Pervez, Farhan
    Sultana, Ajmery
    Yang, Cungang
    Zhao, Lian
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (03) : 1728 - 1741
  • [8] MOIPC-MAAC: Communication-Assisted Multiobjective MARL for Trajectory Planning and Task Offloading in Multi-UAV-Assisted MEC
    Gao, Zhen
    Fu, Jiaming
    Jing, Zongming
    Dai, Yu
    Yang, Lei
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (10): : 18483 - 18502
  • [9] Fairness-Based 3-D Multi-UAV Trajectory Optimization in Multi-UAV-Assisted MEC System
    He, Yejun
    Gan, Youhui
    Cui, Haixia
    Guizani, Mohsen
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (13) : 11383 - 11395
  • [10] Collaborative Computation Offloading, Caching, Communication, Computation, and Trajectory Control in UAV-Assisted MEC System
    Sun, Geng
    Wu, Jiaxu
    Sun, Zemin
    [J]. PROCEEDINGS OF THE ACM TURING AWARD CELEBRATION CONFERENCE-CHINA 2024, ACM-TURC 2024, 2024, : 203 - 204