Deep Reinforcement Learning-Based Task Offloading and Load Balancing for Vehicular Edge Computing

被引:0
|
作者
Wu, Zhoupeng [1 ]
Jia, Zongpu [1 ]
Pang, Xiaoyan [1 ]
Zhao, Shan [1 ]
机构
[1] Henan Polytech Univ, Sch Comp Sci & Technol, Jiaozuo 454000, Peoples R China
基金
中国国家自然科学基金;
关键词
task offloading; resource allocation; edge collaboration; load balancing; deep reinforcement learning; ALGORITHM; INTERNET;
D O I
10.3390/electronics13081511
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Vehicular edge computing (VEC) effectively reduces the computational burden on vehicles by offloading tasks from resource-constrained vehicles to edge nodes. However, non-uniformly distributed vehicles offloading a large number of tasks cause load imbalance problems among edge nodes, resulting in performance degradation. In this paper, we propose a deep reinforcement learning-based decision scheme for task offloading and load balancing with the optimization objective of minimizing the system cost considering the split offloading of tasks and the load dynamics of edge nodes. First, we model the mutual interaction between mobile vehicles and Mobile Edge Computing (MEC) servers using a Markov decision process. Second, the optimal task-offloading and resource allocation decision is obtained by utilizing the twin delayed deep deterministic policy gradient algorithm (TD3), and server load balancing is achieved through edge collaboration using a server selection algorithm based on the technique for order preference by similarity to the ideal solution (TOPSIS). Finally, we have conducted extensive simulation experiments and compared the results with several other baseline schemes. The proposed scheme can more effectively reduce the system cost and increase the system resource utilization.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] Deep Learning-Based Task Offloading for Vehicular Edge Computing
    Zeng, Feng
    Liu, Chengsheng
    Tangjiang, Junzhe
    Li, Wenjia
    [J]. WIRELESS ALGORITHMS, SYSTEMS, AND APPLICATIONS, WASA 2021, PT III, 2021, 12939 : 291 - 298
  • [2] Deep Reinforcement Learning-Based Computation Offloading in Vehicular Edge Computing
    Zhan, Wenhan
    Luo, Chunbo
    Wang, Jin
    Min, Geyong
    Duan, Hancong
    [J]. 2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [3] Deep Reinforcement Learning-Based Task Offloading for Vehicular Edge Computing With Flexible RSU-RSU Cooperation
    Fan, Wenhao
    Zhang, Yaoyin
    Zhou, Guangtao
    Liu, Yuan'an
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (07) : 7712 - 7725
  • [4] Task offloading in vehicular edge computing networks via deep reinforcement learning
    Karimi, Elham
    Chen, Yuanzhu
    Akbari, Behzad
    [J]. COMPUTER COMMUNICATIONS, 2022, 189 : 193 - 204
  • [5] Federated Deep Reinforcement Learning Based Task Offloading with Power Control in Vehicular Edge Computing
    Moon, Sungwon
    Lim, Yujin
    [J]. SENSORS, 2022, 22 (24)
  • [6] Deep reinforcement learning-based online task offloading in mobile edge computing networks
    Wu, Haixing
    Geng, Jingwei
    Bai, Xiaojun
    Jin, Shunfu
    [J]. INFORMATION SCIENCES, 2024, 654
  • [7] Federated Deep Reinforcement Learning-based task offloading system in edge computing environment
    Merakchi, Hiba
    Bagaa, Miloud
    Messaoud, Ahmed Ouameur
    Ksentini, Adlen
    Sehad, Abdenour
    [J]. IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 5580 - 5586
  • [8] Adaptive Learning-Based Task Offloading for Vehicular Edge Computing Systems
    Sun, Yuxuan
    Guo, Xueying
    Song, Jinhui
    Zhou, Sheng
    Jiang, Zhiyuan
    Liu, Xin
    Niu, Zhisheng
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (04) : 3061 - 3074
  • [9] Deep Reinforcement Learning-Guided Task Reverse Offloading in Vehicular Edge Computing
    Gu, Anqi
    Wu, Huaming
    Tang, Huijun
    Tang, Chaogang
    [J]. 2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 2200 - 2205
  • [10] Deep Reinforcement Learning-based Task Offloading in Satellite-Terrestrial Edge Computing Networks
    Zhu, Dali
    Liu, Haitao
    Li, Ting
    Sun, Jiyan
    Liang, Jie
    Zhang, Hangsheng
    Geng, Liru
    Liu, Yudong
    [J]. 2021 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2021,