Multi-Agent Deep Reinforcement Learning-Based Trajectory Planning for Multi-UAV Assisted Mobile Edge Computing

被引:215
|
作者
Wang, Liang [1 ]
Wang, Kezhi [1 ]
Pan, Cunhua [2 ]
Xu, Wei [3 ,4 ]
Aslam, Nauman [1 ]
Hanzo, Lajos [5 ]
机构
[1] Northumbria Univ, Dept Comp & Informat Sci, Newcastle Upon Tyne NE1 8ST, Tyne & Wear, England
[2] Queen Mary Univ London, Sch Elect Engn & Comp Sci, London E1 4NS, England
[3] Southeast Univ, Natl Mobile Commun Res Lab, Nanjing 210096, Peoples R China
[4] Purple Mt Labs, Nanjing 211111, Peoples R China
[5] Univ Southampton, Sch Elect & Comp Sci, Southampton SO17 1BJ, Hants, England
基金
英国工程与自然科学研究理事会;
关键词
Multi-agent deep reinforcement learning; MADDPG; mobile edge computing; UAV; trajectory control; RESOURCE-ALLOCATION; POWER-CONTROL; DESIGN; ALTITUDE; PLACEMENT; NETWORKS;
D O I
10.1109/TCCN.2020.3027695
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
An unmanned aerial vehicle (UAV)-aided mobile edge computing (MEC) framework is proposed, where several UAVs having different trajectories fly over the target area and support the user equipments (UEs) on the ground. We aim to jointly optimize the geographical fairness among all the UEs, the fairness of each UAV' UE-load and the overall energy consumption of UEs. The above optimization problem includes both integer and continues variables and it is challenging to solve. To address the above problem, a multi-agent deep reinforcement learning based trajectory control algorithm is proposed for managing the trajectory of each UAV independently, where the popular Multi-Agent Deep Deterministic Policy Gradient (MADDPG) method is applied. Given the UAVs' trajectories, a low-complexity approach is introduced for optimizing the offloading decisions of UEs. We show that our proposed solution has considerable performance over other traditional algorithms, both in terms of the fairness for serving UEs, fairness of UE-load at each UAV and energy consumption for all the UEs.
引用
收藏
页码:73 / 84
页数:12
相关论文
共 50 条
  • [1] A multi-UAV assisted task offloading and path optimization for mobile edge computing via multi-agent deep reinforcement learning
    Ju, Tao
    Li, Linjuan
    Liu, Shuai
    Zhang, Yu
    [J]. JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2024, 229
  • [2] Multi-agent Deep Reinforcement Learning-based Trajectory Design for UAV-aided Edge Computing System
    Lu, Gengyuan
    Chang, Zheng
    [J]. 2023 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC, 2023,
  • [3] Multi-agent deep reinforcement learning for trajectory planning in UAVs-assisted mobile edge computing with heterogeneous requirements
    Fan, Chenchen
    Xu, Hongyu
    Wang, Qingling
    [J]. COMPUTER NETWORKS, 2024, 248
  • [4] Multi-Agent Deep Reinforcement Learning for Task Offloading in UAV-Assisted Mobile Edge Computing
    Zhao, Nan
    Ye, Zhiyang
    Pei, Yiyang
    Liang, Ying-Chang
    Niyato, Dusit
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (09) : 6949 - 6960
  • [5] Multi-UAV Mobile Edge Computing and Path Planning Platform Based on Reinforcement Learning
    Chang, Huan
    Chen, Yicheng
    Zhang, Baochang
    Doermann, David
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2022, 6 (03): : 489 - 498
  • [6] Multi-Agent Deep Reinforcement Learning-Based Interdependent Computing for Mobile Edge Computing-Assisted Robot Teams
    Cui, Qimei
    Zhao, Xiyu
    Ni, Wei
    Hu, Zheng
    Tao, Xiaofeng
    Zhang, Ping
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (05) : 6599 - 6610
  • [7] Multi-UAV Path Planning and Following Based on Multi-Agent Reinforcement Learning
    Zhao, Xiaoru
    Yang, Rennong
    Zhong, Liangsheng
    Hou, Zhiwei
    [J]. DRONES, 2024, 8 (01)
  • [8] Multi-Agent Deep Reinforcement Learning for Trajectory Design and Power Allocation in Multi-UAV Networks
    Zhao, Nan
    Liu, Zehua
    Cheng, Yiqiang
    [J]. IEEE ACCESS, 2020, 8 : 139670 - 139679
  • [9] Distributed multi-agent deep reinforcement learning for trajectory planning in UAVs-assisted edge offloading
    Fan, Chenchen
    Wang, Qingling
    Wang, Xiangke
    [J]. CCF TRANSACTIONS ON PERVASIVE COMPUTING AND INTERACTION, 2024,
  • [10] Multiagent Reinforcement Learning in Controlling Offloading Ratio and Trajectory for Multi-UAV Mobile-Edge Computing
    Lee, Wonseok
    Kim, Taejoon
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (02) : 3417 - 3429