A Multi-user Computation Offloading Optimization Model and Algorithm Based on Deep Reinforcement Learning

被引:0
|
作者
Li Z. [1 ]
Yu Z. [1 ]
机构
[1] School of Artificial Intelligence and Computer, Jiangnan University, Wuxi
关键词
Computation offloading; Deep reinforcement learning; Mobile Edge Computing(MEC); Resource allocation;
D O I
10.11999/JEIT230445
中图分类号
学科分类号
摘要
In Mobile Edge Computing (MEC) intensive deployment scenarios, the uncertainty of edge server load can easily cause edge server overload, leading to a significant increase in delay and energy consumption during the computation offloading process. In response to this issue, a multi-user computation offloading optimization model and algorithm based on Deep Deterministic Policy Gradient (DDPG) is proposed. Firstly, considering the balance optimization of delay and energy consumption, a utility function is established to maximize system utility as the optimization objective, and the computational offloading problem is transformed into a mixed integer nonlinear programming problem. Then, in response to the problem of large state space and coexistence of discrete and continuous variables in the action space, the DDPG deep reinforcement learning algorithm is discretized and improved. Based on this, a multi-user computation offloading optimization method is proposed. Finally, this method is used to solve nonlinear programming problems. The simulation experimental results show that compared with existing algorithms, the proposed method can effectively reduce the probability of edge server overload and has good stability. © 2024 Science Press. All rights reserved.
引用
收藏
页码:1321 / 1332
页数:11
相关论文
共 28 条
  • [1] ZHOU Zhi, CHEN Xu, LI En, Et al., Edge intelligence: Paving the last mile of artificial intelligence with edge computing[J], Proceedings of the IEEE, 107, 8, pp. 1738-1762, (2019)
  • [2] GERARDS M E T, HURINK J L, KUPER J., On the interplay between global DVFS and scheduling tasks with precedence constraints[J], IEEE Transactions on Computers, 64, 6, pp. 1742-1754, (2015)
  • [3] SADATDIYNOV K, Laizhong CUI, ZHANG Lei, Et al., A review of optimization methods for computation offloading in edge computing networks[J], Digital Communications and Networks, 9, 2, pp. 450-461, (2023)
  • [4] SUN Jiannan, GU Qing, ZHENG Tao, Et al., Joint optimization of computation offloading and task scheduling in vehicular edge computing networks[J], IEEE Access, 8, pp. 10466-10477, (2020)
  • [5] LIU Hui, NIU Zhaocheng, DU Junzhao, Et al., Genetic algorithm for delay efficient computation offloading in dispersed computing, Ad Hoc Networks, 142, (2023)
  • [6] ALAMEDDINE H A, SHARAFEDDINE S, SEBBAH S, Et al., Dynamic task offloading and scheduling for low-latency IoT services in multi-access edge computing[J], IEEE Journal on Selected Areas in Communications, 37, 3, pp. 668-682, (2019)
  • [7] Suzhi BI, HUANG Liang, ZHANG Y J A., Joint optimization of service caching placement and computation offloading in mobile edge computing systems[J], IEEE Transactions on Wireless Communications, 19, 7, pp. 4947-4963, (2020)
  • [8] YI Changyan, CAI Jun, Zhou SU, A multi-user mobile computation offloading and transmission scheduling mechanism for delay-sensitive applications[J], IEEE Transactions on Mobile Computing, 19, 1, pp. 29-43, (2020)
  • [9] MITSIS G, TSIROPOULOU E E, PAPAVASSILIOU S., Price and risk awareness for data offloading decision-making in edge computing systems[J], IEEE Systems Journal, 16, 4, pp. 6546-6557, (2022)
  • [10] ZHANG Kaiyuan, GUI Xiaolin, REN Dewang, Et al., Optimal pricing-based computation offloading and resource allocation for blockchain-enabled beyond 5G networks, Computer Networks, 203, (2022)