Task Offloading Optimization Based on Actor-Critic Algorithm in Vehicle Edge Computing

被引:0
|
作者
Wang, Bingxin [1 ]
Liu, Lei [1 ]
Wang, Jie [1 ]
机构
[1] Telecom Corp Ltd, Beijing Res Inst, Beijing, Peoples R China
基金
国家重点研发计划;
关键词
Vehicle Edge Computing (VEC); Task Offloading; Actor-Critic; RESOURCE-ALLOCATION;
D O I
10.1109/IWCMC58020.2023.10183035
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The rapidly expanding Internet of Vehicles (IoV) poses many challenges, such as the difficulty of providing ubiquitous connectivity and best-in-class services to many vehicles, and the fact that vehicles can generate large amounts of time-sensitive and computationally expensive data. These data cannot be processed in a timely manner because the vehicles lack the computational power of MEC servers due to the limitations of the vehicles' computational power and battery capacity. In this study, we propose a task offloading method for vehicle edge computing (VEC) based on deep reinforcement learning(DRL), which combines reinforcement learning (RL) with deep learning (DL) and can transfer computationally demanding tasks such as data processing to a VEC server with more processing power, and, we use the Actor-Critic algorithm, which transforms the value function table maintenance into the training of neural network models to improve the convergence efficiency and the training effect of the models. Simulation results show that our proposed Actor-Critic based DRL algorithm may significantly improve the effectiveness of VEC servers and reduce the vehicle cost.
引用
收藏
页码:687 / 692
页数:6
相关论文
共 50 条
  • [1] Actor-Critic Based DRL Algorithm for Task Offloading Performance Optimization in Vehicle Edge Computing
    Wang, Bingxin
    Liu, Lei
    Wang, Jie
    [J]. 2023 INTERNATIONAL WIRELESS COMMUNICATIONS AND MOBILE COMPUTING, IWCMC, 2023, : 93 - 98
  • [2] Joint Offloading and Resource Allocation in Mobile Edge Computing Systems: An Actor-Critic Approach
    Zhang, Zhicai
    Yu, F. Richard
    Fu, Fang
    Yan, Qiao
    Wang, Zhouyang
    [J]. 2018 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2018,
  • [3] Intelligent Offloading for Multi-Access Edge Computing: A New Actor-Critic Approach
    Liu, Kai-Hsiang
    Liao, Wanjiun
    [J]. ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
  • [4] Federated Multiagent Actor-Critic Learning Task Offloading in Intelligent Logistics
    Li, Qiqi
    Cui, Yaping
    Song, Tao
    Zheng, Linjiang
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (13) : 11696 - 11707
  • [5] Fine-Grained Offloading for Multi-Access Edge Computing with Actor-Critic Federated Learning
    Liu, Kai-Hsiang
    Hsu, Yi-Huai
    Lin, Wan-Ni
    Liao, Wanjiun
    [J]. 2021 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2021,
  • [6] An Adaptive Threshold for the Canny Edge With Actor-Critic Algorithm
    Choi, Keong-Hun
    Ha, Jong-Eun
    [J]. IEEE ACCESS, 2023, 11 : 67058 - 67069
  • [7] A Hessian Actor-Critic Algorithm
    Wang, Jing
    Paschalidis, Ioannis Ch
    [J]. 2014 IEEE 53RD ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2014, : 1131 - 1136
  • [8] An Actor-Critic Algorithm With Second-Order Actor and Critic
    Wang, Jing
    Paschalidis, Ioannis Ch.
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2017, 62 (06) : 2689 - 2703
  • [9] Granular computing in actor-critic learning
    Peters, James F.
    [J]. 2007 IEEE SYMPOSIUM ON FOUNDATIONS OF COMPUTATIONAL INTELLIGENCE, VOLS 1 AND 2, 2007, : 59 - 64
  • [10] Optimization of Robot Environment Interaction Based on Asynchronous Advantage Actor-Critic Algorithm
    Xu, Jitang
    Chen, Qiang
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (06) : 1350 - 1359