Deep Reinforcement Learning-Based Resource Allocation for Content Distribution in IoT-Edge-Cloud Computing Environments

被引:12
|
作者
Cui, Tongke [1 ]
Yang, Ruopeng [1 ]
Fang, Chao [2 ]
Yu, Shui [3 ]
机构
[1] Natl Univ Def Technol, Coll Informat & Commun, Changsha 410073, Peoples R China
[2] Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
[3] Univ Technol Sydney, Sch Comp Sci, Sydney, NSW 2007, Australia
来源
SYMMETRY-BASEL | 2023年 / 15卷 / 01期
基金
北京市自然科学基金;
关键词
cloud-edge cooperation; queuing theory; deep reinforcement learning; in-networking caching; content popularity; COLLABORATIVE CLOUD; CHINESE FAMINE; EARLY-LIFE; ENERGY; ARCHITECTURE; VEHICLES; TRANSMISSION; MANAGEMENT; EXPOSURE; INTERNET;
D O I
10.3390/sym15010217
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
With the emergence of intelligent terminals, the Internet of Vehicles (IoV) has been drawing great attention by taking advantage of mobile communication technologies. However, high computation complexity, collaboration communication overhead and limited network bandwidths bring severe challenges to the provision of latency-sensitive IoV services. To overcome these problems, we design a cloud-edge cooperative content-delivery strategy in asymmetrical IoV environments to minimize network latency by providing optimal computing, caching and communication resource allocation. We abstract the joint allocation issue of heterogeneous resources as a queuing theory-based latency minimization objective. Next, a new deep reinforcement learning (DRL) scheme works in each network node to achieve optimal content caching and request routing on the basis of the perceptive request history and network state. Extensive simulations show that our proposed strategy has lower network latency compared with the current solutions in the cloud-edge collaboration system and converges fast under different scenarios.
引用
下载
收藏
页数:17
相关论文
共 50 条
  • [31] A Reinforcement Learning-Based Resource Allocation Scheme for Cloud Robotics
    Liu, Hang
    Liu, Shiwen
    Zheng, Kan
    IEEE ACCESS, 2018, 6 : 17215 - 17222
  • [32] Deep reinforcement learning-based algorithms selectors for the resource scheduling in hierarchical Cloud computing
    Zhou G.
    Wen R.
    Tian W.
    Buyya R.
    Journal of Network and Computer Applications, 2022, 208
  • [33] Federated deep reinforcement learning-based online task offloading and resource allocation in harsh mobile edge computing environment
    Xiang, Hui
    Zhang, Meiyu
    Jian, Chengfeng
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2024, 27 (03): : 3323 - 3339
  • [34] Multi-Agent Deep Reinforcement Learning-Based Partial Task Offloading and Resource Allocation in Edge Computing Environment
    Ke, Hongchang
    Wang, Hui
    Sun, Hongbin
    ELECTRONICS, 2022, 11 (15)
  • [35] Joint Service Migration and Resource Allocation in Edge IoT System Based on Deep Reinforcement Learning
    Liu, Fangzheng
    Yu, Hao
    Huang, Jiwei
    Taleb, Tarik
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (07) : 11341 - 11352
  • [36] A Reinforcement Learning-based Orchestrator for Edge Computing Resource Allocation in Mobile Augmented Reality Systems
    Qian, Weiyang
    Coutinho, Rodolfo W. L.
    2023 IEEE 34TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS, PIMRC, 2023,
  • [37] Deep reinforcement learning-based edge computing offloading algorithm for software-defined IoT
    Zhu, Xiaojuan
    Zhang, Tianhao
    Zhang, Jinwei
    Zhao, Bao
    Zhang, Shunxiang
    Wu, Cai
    COMPUTER NETWORKS, 2023, 235
  • [38] Task Offloading and Resource Allocation in IoT Based Mobile Edge Computing Using Deep Learning
    Abdullaev, Ilyos
    Prodanova, Natalia
    Bhaskar, K. Aruna
    Lydia, E. Laxmi
    Kadry, Seifedine
    Kim, Jungeun
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 76 (02): : 1463 - 1477
  • [39] Multi-Agent Reinforcement Learning for Resource Allocation in IoT Networks with Edge Computing
    Liu, Xiaolan
    Yu, Jiadong
    Feng, Zhiyong
    Gao, Yue
    CHINA COMMUNICATIONS, 2020, 17 (09) : 220 - 236
  • [40] Task Offloading and Resource Allocation for Mobile Edge Computing by Deep Reinforcement Learning Based on SARSA
    Alfakih, Taha
    Hassan, Mohammad Mehedi
    Gumaei, Abdu
    Savaglio, Claudio
    Fortino, Giancarlo
    IEEE ACCESS, 2020, 8 : 54074 - 54084