Multi-Agent Deep Reinforcement Learning-Based Partial Task Offloading and Resource Allocation in Edge Computing Environment

被引:8
|
作者
Ke, Hongchang [1 ]
Wang, Hui [2 ]
Sun, Hongbin [1 ]
机构
[1] Changchun Inst Technol, Sch Comp Technol & Engn, Changchun 130012, Peoples R China
[2] Changchun Univ Technol, Coll Comp Sci & Engn, Changchun 130012, Peoples R China
关键词
mobile edge computing; low latency; deep reinforcement learning; partial offloading; resource allocation; MOBILE; SYSTEMS;
D O I
10.3390/electronics11152394
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the dense data communication environment of 5G wireless networks, with the dramatic increase in the amount of request computation tasks generated by intelligent wireless mobile nodes, its computation ability cannot meet the requirements of low latency and high reliability. Mobile edge computing (MEC) can utilize its servers with mighty computation power and closer to tackle the computation tasks offloaded by the wireless node (WN). The physical location of the MEC server is closer to WN, thereby meeting the requirements of low latency and high reliability. In this paper, we implement an MEC framework with multiple WNs and multiple MEC servers, which consider the randomness and divisibility of arrival request tasks from WN, the time-varying channel state between WN and MEC server, and different priorities of tasks. In the proposed MEC system, we present a decentralized multi-agent deep reinforcement learning-based partial task offloading and resource allocation algorithm (DeMADRL) to minimize the long-term weighted cost including delay cost and bandwidth cost. DeMADRL is a model-free scheme based on Double Deep Q-Learning (DDQN) and can obtain the optimal computation offloading and bandwidth allocation decision-making policy by training the neural networks. The comprehensive simulation results show that the proposed DeMADRL optimization scheme has a nice convergence and outperforms the other three baseline algorithms.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] A Task Offloading and Resource Allocation Strategy Based on Multi-Agent Reinforcement Learning in Mobile Edge Computing
    Jiang, Guiwen
    Huang, Rongxi
    Bao, Zhiming
    Wang, Gaocai
    [J]. FUTURE INTERNET, 2024, 16 (09)
  • [2] Federated deep reinforcement learning-based online task offloading and resource allocation in harsh mobile edge computing environment
    Xiang, Hui
    Zhang, Meiyu
    Jian, Chengfeng
    [J]. CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2024, 27 (03): : 3323 - 3339
  • [3] Cooperative Task Offloading for Mobile Edge Computing Based on Multi-Agent Deep Reinforcement Learning
    Yang, Jian
    Yuan, Qifeng
    Chen, Shuangwu
    He, Huasen
    Jiang, Xiaofeng
    Tan, Xiaobin
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2023, 20 (03): : 3205 - 3219
  • [4] Vehicle Speed Aware Computing Task Offloading and Resource Allocation Based on Multi-Agent Reinforcement Learning in a Vehicular Edge Computing Network
    Huang, Xinyu
    He, Lijun
    Zhang, Wanyue
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON EDGE COMPUTING (EDGE 2020), 2020, : 1 - 8
  • [5] A collaborative optimization strategy for computing offloading and resource allocation based on multi-agent deep reinforcement learning
    Jiang, Yingying
    Mao, Yuxuan
    Wu, Gaoxiang
    Cai, Zhenhua
    Hao, Yixue
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2022, 103
  • [6] Optimization of Task Offloading Strategy for Mobile Edge Computing Based on Multi-Agent Deep Reinforcement Learning
    Lu, Haifeng
    Gu, Chunhua
    Luo, Fei
    Ding, Weichao
    Zheng, Shuai
    Shen, Yifan
    [J]. IEEE ACCESS, 2020, 8 : 202573 - 202584
  • [7] Multi-Task Resource Allocation and Task Offloading via Multi-Agent Deep Reinforcement Learning in Edge-Cloud system
    Tian, Guoqing
    Wang, Xilong
    Li, Xin
    Qin, Xiaolin
    [J]. 2024 5TH INTERNATIONAL CONFERENCE ON COMPUTING, NETWORKS AND INTERNET OF THINGS, CNIOT 2024, 2024, : 370 - 377
  • [8] Federated Deep Reinforcement Learning-based task offloading system in edge computing environment
    Merakchi, Hiba
    Bagaa, Miloud
    Messaoud, Ahmed Ouameur
    Ksentini, Adlen
    Sehad, Abdenour
    [J]. IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 5580 - 5586
  • [9] Multi-user Edge Computing Task offloading Scheduling and Resource Allocation Based on Deep Reinforcement Learning
    Kuang, Zhu-Fang
    Chen, Qing-Lin
    Li, Lin-Feng
    Deng, Xiao-Heng
    Chen, Zhi-Gang
    [J]. Jisuanji Xuebao/Chinese Journal of Computers, 2022, 45 (04): : 812 - 824
  • [10] Joint Task and Computing Resource Allocation in Distributed Edge Computing Systems via Multi-Agent Deep Reinforcement Learning
    Chen, Yan
    Sun, Yanjing
    Yu, Hao
    Taleb, Tarik
    [J]. IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2024, 11 (04): : 3479 - 3494