Dynamic Edge Computation Offloading for Internet of Vehicles With Deep Reinforcement Learning

被引:34
|
作者
Yao, Liang [1 ]
Xu, Xiaolong [1 ,2 ,3 ]
Bilal, Muhammad [4 ]
Wang, Huihui [5 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Engn Res Ctr Digital Forens, Jiangsu Collaborat Innovat Ctr Atmospher Environm, Minist Educ, Nanjing 210044, Peoples R China
[3] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing 210023, Peoples R China
[4] Hankuk Univ Foreign Studies, Dept Comp & Elect Syst Engn, Yongin 17035, Gyeonggi Do, South Korea
[5] St Bonaventure Univ, Cybersecur Program, St Bonaventure, NY 14778 USA
关键词
Task analysis; Vehicle dynamics; Delays; Computational modeling; Dynamic scheduling; Edge computing; Processor scheduling; Internet of Vehicles; deep reinforcement learning; edge computing;
D O I
10.1109/TITS.2022.3178759
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Recent developments in the Internet of Vehicles (IoV) enabled the myriad emergence of a plethora of data-intensive and latency-sensitive vehicular applications, posing significant difficulties to traditional cloud computing. Vehicular edge computing (VEC), as an emerging paradigm, enables the vehicles to utilize the resources of the edge servers to reduce the data transfer burden and computing stress. Although the utilization of VEC is a favourable support for IoV applications, vehicle mobility and other factors further complicate the challenge of designing and implementing such systems, leading to incremental delay and energy consumption. In recent times, there have been attempts to integrate deep reinforcement learning (DRL) approaches with IoV-based systems, to facilitate real-time decision-making and prediction. We demonstrate the potential of such an approach in this paper. Specifically, the dynamic computation offloading problem is constructed as a Markov decision process (MDP). Then, the twin delayed deep deterministic policy gradient (TD3) algorithm is utilized to achieve the optimal offloading strategy. Finally, findings from the simulation demonstrate the potential of our proposed approach.
引用
收藏
页码:12991 / 12999
页数:9
相关论文
共 50 条
  • [21] Deep Reinforcement Learning-Based Computation Offloading in Vehicular Edge Computing
    Zhan, Wenhan
    Luo, Chunbo
    Wang, Jin
    Min, Geyong
    Duan, Hancong
    [J]. 2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [22] A Deep Reinforcement Learning Approach Towards Computation Offloading for Mobile Edge Computing
    Wang, Qing
    Tan, Wenan
    Qin, Xiaofan
    [J]. HUMAN CENTERED COMPUTING, 2019, 11956 : 419 - 430
  • [23] A Distributed Computation Offloading Strategy for Edge Computing Based on Deep Reinforcement Learning
    Lai, Hongyang
    Yang, Zhuocheng
    Li, Jinhao
    Wu, Celimuge
    Bao, Wugedele
    [J]. MOBILE NETWORKS AND MANAGEMENT, MONAMI 2021, 2022, 418 : 73 - 86
  • [24] A Deep Reinforcement Learning Approach for Online Computation Offloading in Mobile Edge Computing
    Zhang, Yameng
    Liu, Tong
    Zhu, Yanmin
    Yang, Yuanyuan
    [J]. 2020 IEEE/ACM 28TH INTERNATIONAL SYMPOSIUM ON QUALITY OF SERVICE (IWQOS), 2020,
  • [25] Deep reinforcement learning for the computation offloading in MIMO-based Edge Computing
    Sadiki, Abdeladim
    Bentahar, Jamal
    Dssouli, Rachida
    En-Nouaary, Abdeslam
    Otrok, Hadi
    [J]. AD HOC NETWORKS, 2023, 141
  • [26] RMDDQN-Learning: Computation Offloading Algorithm Based on Dynamic Adaptive Multi-Objective Reinforcement Learning in Internet of Vehicles
    Zhang, Xiangjun
    Wu, Weiguo
    Zhao, Zhihe
    Wang, Jinyu
    Liu, Song
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (09) : 11374 - 11388
  • [27] Joint Data Caching and Computation Offloading in UAV-Assisted Internet of Vehicles via Federated Deep Reinforcement Learning
    Huang, Jiwei
    Zhang, Man
    Wan, Jiangyuan
    Chen, Ying
    Zhang, Ning
    [J]. IEEE Transactions on Vehicular Technology, 2024, 73 (11) : 17644 - 17656
  • [28] Dynamic Edge Computation Offloading for Internet of Things With Energy Harvesting: A Learning Method
    Wei, Ziling
    Zhao, Baokang
    Su, Jinshu
    Lu, Xicheng
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (03) : 4436 - 4447
  • [29] Dynamic Computation Offloading in Edge Computing for Internet of Things
    Chen, Ying
    Zhang, Ning
    Zhang, Yongchao
    Chen, Xin
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (03): : 4242 - 4251
  • [30] Deep Reinforcement Learning for Edge Caching and Content Delivery in Internet of Vehicles
    Dai, Yueyue
    Xu, Du
    Lu, Yunlong
    Maharjan, Sabita
    Zhang, Yan
    [J]. 2019 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA (ICCC), 2019,