Dynamic Edge Computation Offloading for Internet of Vehicles With Deep Reinforcement Learning

被引:34
|
作者
Yao, Liang [1 ]
Xu, Xiaolong [1 ,2 ,3 ]
Bilal, Muhammad [4 ]
Wang, Huihui [5 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Engn Res Ctr Digital Forens, Jiangsu Collaborat Innovat Ctr Atmospher Environm, Minist Educ, Nanjing 210044, Peoples R China
[3] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing 210023, Peoples R China
[4] Hankuk Univ Foreign Studies, Dept Comp & Elect Syst Engn, Yongin 17035, Gyeonggi Do, South Korea
[5] St Bonaventure Univ, Cybersecur Program, St Bonaventure, NY 14778 USA
关键词
Task analysis; Vehicle dynamics; Delays; Computational modeling; Dynamic scheduling; Edge computing; Processor scheduling; Internet of Vehicles; deep reinforcement learning; edge computing;
D O I
10.1109/TITS.2022.3178759
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Recent developments in the Internet of Vehicles (IoV) enabled the myriad emergence of a plethora of data-intensive and latency-sensitive vehicular applications, posing significant difficulties to traditional cloud computing. Vehicular edge computing (VEC), as an emerging paradigm, enables the vehicles to utilize the resources of the edge servers to reduce the data transfer burden and computing stress. Although the utilization of VEC is a favourable support for IoV applications, vehicle mobility and other factors further complicate the challenge of designing and implementing such systems, leading to incremental delay and energy consumption. In recent times, there have been attempts to integrate deep reinforcement learning (DRL) approaches with IoV-based systems, to facilitate real-time decision-making and prediction. We demonstrate the potential of such an approach in this paper. Specifically, the dynamic computation offloading problem is constructed as a Markov decision process (MDP). Then, the twin delayed deep deterministic policy gradient (TD3) algorithm is utilized to achieve the optimal offloading strategy. Finally, findings from the simulation demonstrate the potential of our proposed approach.
引用
收藏
页码:12991 / 12999
页数:9
相关论文
共 50 条
  • [1] Deep Reinforcement Learning for Collaborative Computation Offloading on Internet of Vehicles
    Li, Yureng
    Xu, Shouzhi
    Li, Dawei
    [J]. WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2021, 2021
  • [2] Dynamic Computation Offloading with Deep Reinforcement Learning in Edge Network
    Bai, Yang
    Li, Xiaocui
    Wu, Xinfan
    Zhou, Zhangbing
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (03):
  • [3] Distributed Computation Offloading using Deep Reinforcement Learning in Internet of Vehicles
    Chen, Chen
    Wang, Zheng
    Pei, Qingqi
    He, Ci
    Dou, Zhibin
    [J]. 2020 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA (ICCC), 2020, : 823 - 828
  • [4] Edge QoE: Computation Offloading With Deep Reinforcement Learning for Internet of Things
    Lu, Haodong
    He, Xiaoming
    Du, Miao
    Ruan, Xiukai
    Sun, Yanfei
    Wang, Kun
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (10): : 9255 - 9265
  • [5] Joint Computation Offloading and Resource Allocation for Edge-Cloud Collaboration in Internet of Vehicles via Deep Reinforcement Learning
    Huang, Jiwei
    Wan, Jiangyuan
    Lv, Bofeng
    Ye, Qiang
    Chen, Ying
    [J]. IEEE SYSTEMS JOURNAL, 2023, 17 (02): : 2500 - 2511
  • [6] Task offloading method of edge computing in internet of vehicles based on deep reinforcement learning
    Zhang, Degan
    Cao, Lixiang
    Zhu, Haoli
    Zhang, Ting
    Du, Jinyu
    Jiang, Kaiwen
    [J]. CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2022, 25 (02): : 1175 - 1187
  • [7] Task offloading method of edge computing in internet of vehicles based on deep reinforcement learning
    Degan Zhang
    Lixiang Cao
    Haoli Zhu
    Ting Zhang
    Jinyu Du
    Kaiwen Jiang
    [J]. Cluster Computing, 2022, 25 : 1175 - 1187
  • [8] A Deep-Reinforcement-Learning-Based Computation Offloading With Mobile Vehicles in Vehicular Edge Computing
    Lin, Jie
    Huang, Siqi
    Zhang, Hanlin
    Yang, Xinyu
    Zhao, Peng
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (17) : 15501 - 15514
  • [9] Deep Reinforcement Learning and Game Theory for Computation Offloading in Dynamic Edge Computing Markets
    Li, Shuyang
    Hu, Xiaohui
    Du, Yongwen
    [J]. IEEE ACCESS, 2021, 9 : 121456 - 121466
  • [10] Computation offloading and tasks scheduling for the internet of vehicles in edge computing: A deep reinforcement learning-based pointer network approach
    Ju, Xiang
    Su, Shengchao
    Xu, Chaojie
    Wang, Haoxuan
    [J]. COMPUTER NETWORKS, 2023, 223