Deep Reinforcement Learning for Shared Offloading Strategy in Vehicle Edge Computing

被引:19
|
作者
Peng, Xin [1 ]
Han, Zhengke [1 ]
Xie, Wenwu [1 ]
Yu, Chao [1 ]
Zhu, Peng [1 ]
Xiao, Jian [1 ]
Yang, Jinxia [1 ]
机构
[1] Hunan Inst Sci & Technol, Sch Informat Sci & Engn, Yueyang 414015, Peoples R China
来源
IEEE SYSTEMS JOURNAL | 2023年 / 17卷 / 02期
关键词
Task analysis; Servers; Optimization; Edge computing; Computational modeling; Reinforcement learning; Delays; Deep reinforcement learning (DRL); Internet of Vehicles (IoVs); task shared offloading; vehicular edge computing (VEC); RESOURCE-ALLOCATION; VEHICULAR NETWORKS; SCHEME;
D O I
10.1109/JSYST.2022.3190926
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Vehicular edge computing (VEC) effectively reduces the computing load of vehicles by offloading computing tasks from vehicle terminals to edge servers. However, offloading of tasks increase in quantity the transmission time and energy of the network. In order to reduce the computing load of edge servers and improve the system response, a shared offloading strategy based on deep reinforcement learning is proposed for the complex computing environment of Internet of Vehicles (IoVs). The shared offloading strategy exploits the commonality of vehicles task requests, similar computing tasks coming from different vehicles can share the computing results of former task submitted. The shared offloading strategy can be adapted to the complex scenarios of the IoVs. Each vehicle can share the offloading conditions of the VEC servers, and then adaptively select three computing modes: local execution, task offloading, and shared offloading. In this article, the network state and offloading strategy space are the input of the deep reinforcement learning (DRL). Through the DRL, each task unit selects the offloading strategy with the optimal energy consumption at each time period in the dynamic IoVs transmission and computing environment. Compared with the existing proposals and DRL-based algorithms, it can effectively reduce the delay and energy consumption required for tasks offloading.
引用
收藏
页码:2089 / 2100
页数:12
相关论文
共 50 条
  • [1] Computation offloading strategy based on deep reinforcement learning for connected and autonomous vehicle in vehicular edge computing
    Lin, Bing
    Lin, Kai
    Lin, Changhang
    Lu, Yu
    Huang, Ziqing
    Chen, Xinwei
    [J]. JOURNAL OF CLOUD COMPUTING-ADVANCES SYSTEMS AND APPLICATIONS, 2021, 10 (01):
  • [2] Computation offloading strategy based on deep reinforcement learning for connected and autonomous vehicle in vehicular edge computing
    Bing Lin
    Kai Lin
    Changhang Lin
    Yu Lu
    Ziqing Huang
    Xinwei Chen
    [J]. Journal of Cloud Computing, 10
  • [3] Deep Reinforcement Learning for Offloading and Resource Allocation in Vehicle Edge Computing and Networks
    Liu, Yi
    Yu, Huimin
    Xie, Shengli
    Zhang, Yan
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (11) : 11158 - 11168
  • [4] Overall computing offloading strategy based on deep reinforcement learning in vehicle fog computing
    Tan, HaiZhong
    Zhu, Limin
    [J]. JOURNAL OF ENGINEERING-JOE, 2020, 2020 (11): : 1080 - 1087
  • [5] A Distributed Computation Offloading Strategy for Edge Computing Based on Deep Reinforcement Learning
    Lai, Hongyang
    Yang, Zhuocheng
    Li, Jinhao
    Wu, Celimuge
    Bao, Wugedele
    [J]. MOBILE NETWORKS AND MANAGEMENT, MONAMI 2021, 2022, 418 : 73 - 86
  • [6] A High Reliable Computing Offloading Strategy Using Deep Reinforcement Learning for IoVs in Edge Computing
    Wang, Kun
    Wang, Xiaofeng
    Liu, Xuan
    [J]. JOURNAL OF GRID COMPUTING, 2021, 19 (02)
  • [7] A High Reliable Computing Offloading Strategy Using Deep Reinforcement Learning for IoVs in Edge Computing
    Kun Wang
    Xiaofeng Wang
    Xuan Liu
    [J]. Journal of Grid Computing, 2021, 19
  • [8] A Deep Reinforcement Learning Based Offloading Game in Edge Computing
    Zhan, Yufeng
    Guo, Song
    Li, Peng
    Zhang, Jiang
    [J]. IEEE TRANSACTIONS ON COMPUTERS, 2020, 69 (06) : 883 - 893
  • [9] Computation Offloading in Edge Computing Based on Deep Reinforcement Learning
    Li, MingChu
    Mao, Ning
    Zheng, Xiao
    Gadekallu, Thippa Reddy
    [J]. PROCEEDINGS OF INTERNATIONAL CONFERENCE ON COMPUTING AND COMMUNICATION NETWORKS (ICCCN 2021), 2022, 394 : 339 - 353
  • [10] Dependent Task-Offloading Strategy Based on Deep Reinforcement Learning in Mobile Edge Computing
    Gong, Bencan
    Jiang, Xiaowei
    [J]. WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2023, 2023