A resource allocation strategy for internet of vehicles using reinforcement learning in edge computing environment

被引:0
|
作者
Li, Yihong [1 ]
Liu, Zhengli [2 ]
Tao, Qi [3 ]
机构
[1] Zhaoqing Univ, Sch Comp Sci & Software, Sch Big Data, Zhaoqing 526000, Guangdong, Peoples R China
[2] Wuhan Univ, Sch Comp Sci, Wuhan 430000, Hubei, Peoples R China
[3] Wuhan Univ, Sch Cyber Sci & Engn, Wuhan 430000, Hubei, Peoples R China
关键词
Edge cloud computing; Reinforcement learning; Internet of vehicles; Resource allocation strategy; Double deep Q network model; Network delay; Computing energy consumption; TASK OFFLOADING STRATEGY; FOG; ARCHITECTURE;
D O I
10.1007/s00500-022-07544-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Because the traditional computing model can no longer meet the particularity of Internet of Vehicles tasks, aiming at its characteristics of high bandwidth, low latency and high reliability, this paper proposes a resource allocation strategy for Internet of Vehicles using reinforcement learning in edge cloud computing environment. First, a multi-layer resource allocation model for Internet of Vehicles is proposed, which uses the cooperation mode of edge cloud computing servers and roadside units to dynamically coordinate edge computing and content caching. Then, based on the construction of communication model, calculation model and cache model, make full use of idle resources in Internet of Vehicles to minimize network delay under the condition of limited energy consumption. Finally, the optimization goal is solved by two-layer deep Q network model, and the best resource allocation plan is obtained. The simulation results based on the Internet of Vehicles model show that the computational energy consumption and system delay of proposed strategy do not exceed 400 J and 600 ms, respectively. Besides, the overall effect of resource allocation is better than other comparison strategies and it has certain application prospects.
引用
下载
收藏
页码:3999 / 4009
页数:11
相关论文
共 50 条
  • [1] A resource allocation strategy for internet of vehicles using reinforcement learning in edge computing environment
    Yihong Li
    Zhengli Liu
    Qi Tao
    Soft Computing, 2023, 27 : 3999 - 4009
  • [2] Resource Allocation Strategy of Internet of Vehicles Using Reinforcement Learning
    Xi, Hongqi
    Sun, Huijuan
    JOURNAL OF INFORMATION PROCESSING SYSTEMS, 2022, 18 (03): : 443 - 456
  • [3] Computing Resource Allocation Strategy Based on Mobile Edge Computing in Internet of Vehicles Environment
    Gao, Deng
    MOBILE INFORMATION SYSTEMS, 2022, 2022
  • [4] Adaptive Resource Allocation for Mobile Edge Computing in Internet of Vehicles: A Deep Reinforcement Learning Approach
    Zhao, Junhui
    Quan, Haoyu
    Xia, Minghua
    Wang, Dongming
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (04) : 5834 - 5848
  • [5] Resource Allocation Strategy Using Deep Reinforcement Learning in Cloud-Edge Collaborative Computing Environment
    Cen, Junjie
    Li, Yongbo
    MOBILE INFORMATION SYSTEMS, 2022, 2022
  • [6] Computing resource allocation scheme of IOV using deep reinforcement learning in edge computing environment
    Yiwei Zhang
    Min Zhang
    Caixia Fan
    Fuqiang Li
    Baofang Li
    EURASIP Journal on Advances in Signal Processing, 2021
  • [7] Computing resource allocation scheme of IOV using deep reinforcement learning in edge computing environment
    Zhang, Yiwei
    Zhang, Min
    Fan, Caixia
    Li, Fuqiang
    Li, Baofang
    EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2021, 2021 (01)
  • [8] Task Offloading Strategy Based on Reinforcement Learning Computing in Edge Computing Architecture of Internet of Vehicles
    Wang, Kun
    Wang, Xiaofeng
    Liu, Xuan
    Jolfaei, Alireza
    IEEE ACCESS, 2020, 8 : 173779 - 173789
  • [9] Computing Resource Allocation Strategy Based on Cloud-Edge Cluster Collaboration in Internet of Vehicles
    Shen, Xianhao
    Wang, Li
    Zhang, Panfeng
    Xie, Xiaolan
    Chen, Yi
    Lu, Shaofang
    IEEE ACCESS, 2024, 12 : 10790 - 10803
  • [10] Reinforcement Learning Enabled Dynamic Resource Allocation in the Internet of Vehicles
    Liang, Hongbin
    Zhang, Xiaohui
    Hong, Xintao
    Zhang, Zongyuan
    Li, Mushu
    Hu, Guangdi
    Hou, Fen
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (07) : 4957 - 4967