A Multi-user Computation Offloading Optimization Model and Algorithm Based on Deep Reinforcement Learning

被引：0
|
作者：
Li Z. [1 ]
Yu Z. [1 ]
机构：
[1] School of Artificial Intelligence and Computer, Jiangnan University, Wuxi
来源：
Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology | 2024年 / 46卷 / 04期
关键词：
Computation offloading; Deep reinforcement learning; Mobile Edge Computing(MEC); Resource allocation;
D O I：
10.11999/JEIT230445
中图分类号：
学科分类号：
摘要：
In Mobile Edge Computing (MEC) intensive deployment scenarios, the uncertainty of edge server load can easily cause edge server overload, leading to a significant increase in delay and energy consumption during the computation offloading process. In response to this issue, a multi-user computation offloading optimization model and algorithm based on Deep Deterministic Policy Gradient (DDPG) is proposed. Firstly, considering the balance optimization of delay and energy consumption, a utility function is established to maximize system utility as the optimization objective, and the computational offloading problem is transformed into a mixed integer nonlinear programming problem. Then, in response to the problem of large state space and coexistence of discrete and continuous variables in the action space, the DDPG deep reinforcement learning algorithm is discretized and improved. Based on this, a multi-user computation offloading optimization method is proposed. Finally, this method is used to solve nonlinear programming problems. The simulation experimental results show that compared with existing algorithms, the proposed method can effectively reduce the probability of edge server overload and has good stability. © 2024 Science Press. All rights reserved.
引用
收藏
页码：1321 / 1332
页数：11
相关论文
共 28 条
  • [21] TR 36.814 v9.0. 0. Further advancements for E-UTRA physical layer aspects, (2010)
  • [22] WANG Yanting, SHENG Min, WANG Xijun, Et al., Mobile-edge computing: Partial computation offloading using dynamic voltage scaling[J], IEEE Transactions on Communications, 64, 10, pp. 4268-4282, (2016)
  • [23] ZHANG Ke, MAO Yuming, LENG Supeng, Et al., Energy-efficient offloading for mobile edge computing in 5G heterogeneous networks[J], IEEE Access, 4, pp. 5896-5907, (2016)
  • [24] ZHANG Lianhong, ZHOU Wenqi, XIA Junjuan, Et al., DQN-based mobile edge computing for smart Internet of vehicle, EURASIP Journal on Advances in Signal Processing, 2022, 1, (2022)
  • [25] WANG Jin, HU Jia, MIN Geyong, Et al., Dependent task offloading for edge computing based on deep reinforcement learning[J], IEEE Transactions on Computers, 71, 10, pp. 2449-2461, (2022)
  • [26] SUTTON R S, BARTO A G., Reinforcement Learning: An Introduction, pp. 47-50, (2018)
  • [27] LIU Y C, HUANG Chiyu, DDPG-based adaptive robust tracking control for aerial manipulators with decoupling approach[J], IEEE Transactions on Cybernetics, 52, 8, pp. 8258-8271, (2022)
  • [28] Shihong HU, Guanghui LI, Dynamic request scheduling optimization in mobile edge computing for IoT applications[J], IEEE Internet of Things Journal, 7, 2, pp. 1426-1437, (2020)
123