DRL-Based Joint Task Scheduling and Trajectory Planning Method for UAV-Assisted MEC Scenarios

被引:0
|
作者
Li, Fan [1 ]
Gu, Cheng [2 ,3 ]
Liu, Dong-Sheng [4 ]
Wu, Yi-Xuan [4 ]
Wang, He-Xing [4 ]
机构
[1] Wuhan Univ, Sch Informat Management, Wuhan 430072, Peoples R China
[2] Inner Mongolia Univ, Sch Comp Sci, Hohhot 010000, Peoples R China
[3] Inner Mongolia Univ, Coll Software, Hohhot 010000, Peoples R China
[4] Northeastern Univ Qinhuangdao, Sch Comp & Commun Engn, Qinhuangdao 066004, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Autonomous aerial vehicles; Servers; Signal to noise ratio; Computational modeling; Real-time systems; Internet of Things; Resource management; Processor scheduling; Data models; Trajectory planning; Mobile edge computing; UAV; deep deterministic policy gradient; task offloading; trajectory planning;
D O I
10.1109/ACCESS.2024.3479312
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The proliferation of Internet of Things (IoT) devices has resulted in a massive increase in data generation, necessitating robust solutions for real-time data processing and analysis. The integration of Unmanned Aerial Vehicles (UAVs) with MEC systems presents a promising enhancement, providing dynamic, mobile edge computing capabilities that can adapt to changing conditions and demands. However, efficiently managing the task offloading and trajectory planning of UAVs in such scenarios poses significant challenges, particularly in maximizing coverage while minimizing time and energy consumption. In this context, this paper proposes a novel UAV-based MEC model utilizing the Multi-Agent Deep Deterministic Policy Gradient (MADDPG) reinforcement learning algorithm to optimize task scheduling and UAV trajectory in real-time. Our model enables UAVs to function as mobile edge servers, dynamically processing and routing tasks between terminal devices and edge servers based on real-time device demands. By incorporating a sophisticated reward function that prioritizes the minimization of system costs-including energy, time, and throughput maximization-our approach not only enhances the operational efficiency of UAV-assisted MEC systems but also improves the quality and responsiveness of edge computing services. After training the MADDPG model in the simulated environment, the experiments show that our approach significantly improved the performance of UAV-assisted MEC systems in real-time scenarios, converging after 50 learning episodes and achieving 90% task completion rate.
引用
收藏
页码:156224 / 156234
页数:11
相关论文
共 50 条
  • [1] UAV-Assisted MEC System With Mobile Ground Terminals: DRL-Based Joint Terminal Scheduling and UAV 3D Trajectory Design
    Gao, Yunfei
    Yuan, Xiaopeng
    Yang, Dingcheng
    Hu, Yulin
    Cao, Yue
    Schmeink, Anke
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (07) : 10164 - 10180
  • [2] Flying MEC: Online Task Offloading, Trajectory Planning and Charging Scheduling for UAV-Assisted MEC
    Wei, Qian
    Ouyang, Tao
    Zhou, Zhi
    Chen, Xu
    ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2021, PT I, 2022, 13155 : 460 - 475
  • [3] DRL-Based Contract Incentive for Wireless-Powered and UAV-Assisted Backscattering MEC System
    Chen, Che
    Gong, Shimin
    Zhang, Wenjie
    Zheng, Yifeng
    Kiat, Yeo Chai
    IEEE TRANSACTIONS ON CLOUD COMPUTING, 2024, 12 (01) : 264 - 276
  • [4] DRL-Based Computation-Efficient Offloading and Power Control for UAV-Assisted MEC Networks
    Priya, B.
    Nandhini, J. M.
    Uma, S.
    Anuratha, K.
    TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES, 2024, 35 (12):
  • [5] DRL-Based Trajectory Optimization and Task Offloading in Hierarchical Aerial MEC
    Hu, Zhihao
    Yang, Yaozong
    Gu, Wei
    Chen, Ying
    Huang, Jiwei
    IEEE INTERNET OF THINGS JOURNAL, 2025, 12 (03): : 3410 - 3423
  • [6] DRL-based UAV Trajectory Planning for AoS and Energy Consumption Minimization Assisted by AoI
    Liu, Yunchao
    Gong, Jie
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 1866 - 1871
  • [7] A Spiking Reinforcement Trajectory Planning for UAV-Assisted MEC Systems
    Xia, Zeyang
    Dong, Li
    Jiang, Feibo
    IEEE ACCESS, 2024, 12 : 54435 - 54448
  • [8] Task offloading and multi-cache placement based on DRL in UAV-assisted MEC networks ☆
    Xue, Kai
    Zhai, Linbo
    Li, Yumei
    Lu, Zekun
    Zhou, Wenjie
    VEHICULAR COMMUNICATIONS, 2025, 53
  • [9] UAV-Assisted MEC System Considering UAV Trajectory and Task Offloading Strategy
    Xiang, Kun
    He, Yejun
    ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 4677 - 4682
  • [10] Multi-UAV Assisted Air-Ground Collaborative MEC System: DRL-Based Joint Task Offloading and Resource Allocation and 3D UAV Trajectory Optimization
    Wang, Mingjun
    Li, Ruishan
    Jing, Feng
    Gao, Mei
    DRONES, 2024, 8 (09)