Efficient End-Edge-Cloud Task Offloading in 6G Networks Based on Multiagent Deep Reinforcement Learning

被引:2
|
作者
She, Hao [1 ,2 ]
Yan, Lixing [1 ,2 ]
Guo, Yongan [1 ,2 ]
机构
[1] Nanjing Univ Posts & Telecommun, Minist Educ, Coll Telecommun & Informat Engn, Engn Res Ctr Hlth Serv Syst Based Ubiquitous Wirel, Nanjing 210003, Jiangsu, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Edge Intelligence Res Inst, Nanjing 210003, Jiangsu, Peoples R China
来源
IEEE INTERNET OF THINGS JOURNAL | 2024年 / 11卷 / 11期
关键词
Task analysis; 6G mobile communication; Servers; Computational modeling; Cloud computing; Resource management; Delays; 6G; end-edge-cloud; multiagent deep reinforcement learning (MADRL); task offloading; RESOURCE-ALLOCATION; OPTIMIZATION; ARCHITECTURE; IOT;
D O I
10.1109/JIOT.2024.3372614
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the progressive evolution of the sixth-generation (6G) network, an array of diverse application tasks is experiencing a steady surge, consequently intensifying the computational pressure. However, even with highly optimized task offloading approaches, ensuring overall service quality for rapidly expanding network applications remains challenging due to hardware resource limitations. This article proposes a deep reinforcement learning-based algorithm utilizing a multiagent approach in the end-edge-cloud architecture for 6G networks. The offloading issue can be reformulated to a decentralized partially observable Markov decision process, which transfers the NP-hard problem. We design an efficient algorithm based on multiagent deep deterministic policy gradient (MADDPG) to observe the states of user equipments (UEs), edge servers, and cloud servers, thereby reducing offloading delay and energy consumption. Numerical results demonstrate that our proposed algorithm demonstrates superior performance compared to conventional and state-of-the-art approaches.
引用
收藏
页码:20260 / 20270
页数:11
相关论文
共 50 条
  • [41] Research on Task Offloading Based on Deep Reinforcement Learning in Mobile Edge Computing
    Lu H.
    Gu C.
    Luo F.
    Ding W.
    Yang T.
    Zheng S.
    Gu, Chunhua (chgu@ecust.edu.cn), 1600, Science Press (57): : 1539 - 1554
  • [42] Task offloading of edge computing network based on Lyapunov and deep reinforcement learning
    Qiao, Xudong
    Zhou, Yongxin
    2024 9TH INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATION SYSTEMS, ICCCS 2024, 2024, : 1054 - 1059
  • [43] Task Offloading Optimization in Mobile Edge Computing based on Deep Reinforcement Learning
    Silva, Carlos
    Magaia, Naercio
    Grilo, Antonio
    PROCEEDINGS OF THE INT'L ACM CONFERENCE ON MODELING, ANALYSIS AND SIMULATION OF WIRELESS AND MOBILE SYSTEMS, MSWIM 2023, 2023, : 109 - 118
  • [44] Research on Task Offloading and Typical Application Based on Deep Reinforcement Learning and Device-Edge-Cloud Collaboration
    Zeng, Lingqiu
    Hu, Han
    Han, Qingwen
    Ye, Lei
    Lei, Yu
    2024 AUSTRALIAN & NEW ZEALAND CONTROL CONFERENCE, ANZCC, 2024, : 13 - 18
  • [45] Deep Reinforcement Learning-Based Multi-node Collaborative Task Offloading Optimization in 6G Space-Air-Ground Integrated Networks
    Li, Wang
    Chen, Xin
    Jiao, Libo
    Ning, Wangzhong
    Zhu, Wenwu
    MOBILE AND UBIQUITOUS SYSTEMS: COMPUTING, NETWORKING AND SERVICES, MOBIQUITOUS 2023, PT I, 2024, 593 : 313 - 332
  • [46] Cooperative End-Edge-Cloud Computing and Resource Allocation for Digital Twin Enabled 6G Industrial IoT
    Wang, Yuao
    Fang, Jingjing
    Cheng, Yao
    She, Hao
    Guo, Yongan
    Zheng, Gan
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2024, 18 (01) : 124 - 137
  • [47] End-Edge-Cloud Collaborative Computing for Deep Learning: A Comprehensive Survey
    Wang, Yingchao
    Yang, Chen
    Lan, Shulin
    Zhu, Liehuang
    Zhang, Yan
    IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2024, 26 (04): : 2647 - 2683
  • [48] Adaptive Task Scheduling via End-Edge-Cloud Cooperation in Vehicular Networks
    Ren, Hualing
    Liu, Kai
    Dai, Penglin
    Li, Yantao
    Xie, Ruitao
    Guo, Songtao
    WIRELESS ALGORITHMS, SYSTEMS, AND APPLICATIONS, PT I, 2020, 12384 : 407 - 419
  • [49] Privacy-Aware Multiagent Deep Reinforcement Learning for Task Offloading in VANET
    Wei, Dawei
    Zhang, Junying
    Shojafar, Mohammad
    Kumari, Saru
    Xi, Ning
    Ma, Jianfeng
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (11) : 13108 - 13122
  • [50] A Cloud-Edge Collaborative Computing Task Scheduling Algorithm for 6G Edge Networks
    Ma L.
    Liu M.
    Li C.
    Lu Z.-M.
    Ma H.
    Ma, Huan (mahuan@cert.org.cn), 1600, Beijing University of Posts and Telecommunications (43): : 66 - 73