Efficient End-Edge-Cloud Task Offloading in 6G Networks Based on Multiagent Deep Reinforcement Learning

被引:2
|
作者
She, Hao [1 ,2 ]
Yan, Lixing [1 ,2 ]
Guo, Yongan [1 ,2 ]
机构
[1] Nanjing Univ Posts & Telecommun, Minist Educ, Coll Telecommun & Informat Engn, Engn Res Ctr Hlth Serv Syst Based Ubiquitous Wirel, Nanjing 210003, Jiangsu, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Edge Intelligence Res Inst, Nanjing 210003, Jiangsu, Peoples R China
来源
IEEE INTERNET OF THINGS JOURNAL | 2024年 / 11卷 / 11期
关键词
Task analysis; 6G mobile communication; Servers; Computational modeling; Cloud computing; Resource management; Delays; 6G; end-edge-cloud; multiagent deep reinforcement learning (MADRL); task offloading; RESOURCE-ALLOCATION; OPTIMIZATION; ARCHITECTURE; IOT;
D O I
10.1109/JIOT.2024.3372614
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the progressive evolution of the sixth-generation (6G) network, an array of diverse application tasks is experiencing a steady surge, consequently intensifying the computational pressure. However, even with highly optimized task offloading approaches, ensuring overall service quality for rapidly expanding network applications remains challenging due to hardware resource limitations. This article proposes a deep reinforcement learning-based algorithm utilizing a multiagent approach in the end-edge-cloud architecture for 6G networks. The offloading issue can be reformulated to a decentralized partially observable Markov decision process, which transfers the NP-hard problem. We design an efficient algorithm based on multiagent deep deterministic policy gradient (MADDPG) to observe the states of user equipments (UEs), edge servers, and cloud servers, thereby reducing offloading delay and energy consumption. Numerical results demonstrate that our proposed algorithm demonstrates superior performance compared to conventional and state-of-the-art approaches.
引用
收藏
页码:20260 / 20270
页数:11
相关论文
共 50 条
  • [21] Multiagent Reinforcement Learning-Based Cooperative Multitype Task Offloading Strategy for Internet of Vehicles in B5G/6G Network
    Cui, Yuya
    Li, Honghu
    Zhang, Degan
    Zhu, Aixi
    Li, Yang
    Qiang, Hao
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (14) : 12248 - 12260
  • [22] Federated Deep Reinforcement Learning for Task Offloading in Digital Twin Edge Networks
    Dai, Yueyue
    Zhao, Jintang
    Zhang, Jing
    Zhang, Yan
    Jiang, Tao
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2024, 11 (03): : 2849 - 2863
  • [23] Dependent Task Offloading for Edge Computing based on Deep Reinforcement Learning
    Wang, Jin
    Hu, Jia
    Min, Geyong
    Zhan, Wenhan
    Zomaya, Albert Y.
    Georgalas, Nektarios
    IEEE TRANSACTIONS ON COMPUTERS, 2022, 71 (10) : 2449 - 2461
  • [24] Task offloading in vehicular edge computing networks via deep reinforcement learning
    Karimi, Elham
    Chen, Yuanzhu
    Akbari, Behzad
    COMPUTER COMMUNICATIONS, 2022, 189 : 193 - 204
  • [25] Deep reinforcement learning-based online task offloading in mobile edge computing networks
    Wu, Haixing
    Geng, Jingwei
    Bai, Xiaojun
    Jin, Shunfu
    INFORMATION SCIENCES, 2024, 654
  • [26] QoE-Based Cooperative Task Offloading with Deep Reinforcement Learning in Mobile Edge Networks
    He, Xiaoming
    Lu, Haodong
    Huang, Huawei
    Mao, Yingchi
    Wang, Kun
    Guo, Song
    IEEE WIRELESS COMMUNICATIONS, 2020, 27 (03) : 111 - 117
  • [27] A Deep Reinforcement Learning Approach for Efficient Image Processing Task Offloading in Edge-Cloud Collaborative Environments
    Sun, Ming
    Bao, Tie
    Xie, Dan
    Lv, Hengyi
    Si, Guoliang
    TRAITEMENT DU SIGNAL, 2023, 40 (04) : 1329 - 1339
  • [28] Deep Reinforcement Learning techniques for dynamic task offloading in the 5G edge-cloud continuum
    Nieto, Gorka
    de la Iglesia, Idoia
    Lopez-Novoa, Unai
    Perfecto, Cristina
    JOURNAL OF CLOUD COMPUTING-ADVANCES SYSTEMS AND APPLICATIONS, 2024, 13 (01):
  • [29] Task Offloading in Cloud-Edge Collaborative Environment Based on Deep Reinforcement Learning and Fuzzy Logic
    Wu, Xiaojun
    Wang, Lulu
    Yuan, Sheng
    Chai, Wei
    2024 IEEE 4TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND ARTIFICIAL INTELLIGENCE, SEAI 2024, 2024, : 301 - 308
  • [30] Generative AI as a Service in 6G Edge-Cloud: Generation Task Offloading by In-Context Learning
    Zhou, Hao
    Hu, Chengming
    Yuan, Dun
    Yuan, Ye
    Wu, Di
    Liu, Xue
    Han, Zhu
    Zhang, Jianzhong
    IEEE WIRELESS COMMUNICATIONS LETTERS, 2025, 14 (03) : 711 - 715