Deep Reinforcement Learning-Based Resource Allocation for Content Distribution in IoT-Edge-Cloud Computing Environments

被引:12
|
作者
Cui, Tongke [1 ]
Yang, Ruopeng [1 ]
Fang, Chao [2 ]
Yu, Shui [3 ]
机构
[1] Natl Univ Def Technol, Coll Informat & Commun, Changsha 410073, Peoples R China
[2] Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
[3] Univ Technol Sydney, Sch Comp Sci, Sydney, NSW 2007, Australia
来源
SYMMETRY-BASEL | 2023年 / 15卷 / 01期
基金
北京市自然科学基金;
关键词
cloud-edge cooperation; queuing theory; deep reinforcement learning; in-networking caching; content popularity; COLLABORATIVE CLOUD; CHINESE FAMINE; EARLY-LIFE; ENERGY; ARCHITECTURE; VEHICLES; TRANSMISSION; MANAGEMENT; EXPOSURE; INTERNET;
D O I
10.3390/sym15010217
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
With the emergence of intelligent terminals, the Internet of Vehicles (IoV) has been drawing great attention by taking advantage of mobile communication technologies. However, high computation complexity, collaboration communication overhead and limited network bandwidths bring severe challenges to the provision of latency-sensitive IoV services. To overcome these problems, we design a cloud-edge cooperative content-delivery strategy in asymmetrical IoV environments to minimize network latency by providing optimal computing, caching and communication resource allocation. We abstract the joint allocation issue of heterogeneous resources as a queuing theory-based latency minimization objective. Next, a new deep reinforcement learning (DRL) scheme works in each network node to achieve optimal content caching and request routing on the basis of the perceptive request history and network state. Extensive simulations show that our proposed strategy has lower network latency compared with the current solutions in the cloud-edge collaboration system and converges fast under different scenarios.
引用
下载
收藏
页数:17
相关论文
共 50 条
  • [11] Security computing resource allocation based on deep reinforcement learning in serverless multi-cloud edge computing
    Zhang, Hang
    Wang, Jinsong
    Zhang, Hongwei
    Bu, Chao
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 151 : 152 - 161
  • [12] Task offloading and resource allocation algorithm based on deep reinforcement learning for distributed AI execution tasks in IoT edge computing environments
    Aghapour, Zahra
    Sharifian, Saeed
    Taheri, Hassan
    COMPUTER NETWORKS, 2023, 223
  • [13] Resource Allocation Method of Edge IoT Agent Based on Deep Reinforcement Learning
    Zhong, Jiayong
    Hu, Ke
    Lv, Xiaohong
    Chen, Yongtao
    Gao, Jin
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2024, 33 (05)
  • [14] Resource Allocation for Edge Computing in IoT Networks via Reinforcement Learning
    Liu, Xiaolan
    Qin, Zhijin
    Gao, Yue
    ICC 2019 - 2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2019,
  • [15] Quantum Deep Reinforcement Learning for Dynamic Resource Allocation in Mobile Edge Computing-Based IoT Systems
    Ansere, James Adu
    Gyamfi, Eric
    Sharma, Vishal
    Shin, Hyundong
    Dobre, Octavia A.
    Duong, Trung Q.
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (06) : 6221 - 6233
  • [16] Deep reinforcement learning based resource allocation in edge-cloud gaming
    Jaya I.
    Li Y.
    Cai W.
    Multimedia Tools and Applications, 2024, 83 (26) : 67903 - 67926
  • [17] A Deep Reinforcement Learning-Based Resource Management Game in Vehicular Edge Computing
    Zhu, Xiaoyu
    Luo, Yueyi
    Liu, Anfeng
    Xiong, Neal N.
    Dong, Mianxiong
    Zhang, Shaobo
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (03) : 2422 - 2433
  • [18] Deep reinforcement learning-based computation offloading and resource allocation in security-aware mobile edge computing
    H. C. Ke
    H. Wang
    H. W. Zhao
    W. J. Sun
    Wireless Networks, 2021, 27 : 3357 - 3373
  • [19] Deep reinforcement learning-based computation offloading and resource allocation in security-aware mobile edge computing
    Ke, H. C.
    Wang, H.
    Zhao, H. W.
    Sun, W. J.
    WIRELESS NETWORKS, 2021, 27 (05) : 3357 - 3373
  • [20] Multiuser Resource Control With Deep Reinforcement Learning in IoT Edge Computing
    Lei, Lei
    Xu, Huijuan
    Xiong, Xiong
    Zheng, Kan
    Xiang, Wei
    Wang, Xianbin
    IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (06) : 10119 - 10133