Deep Reinforcement Learning-Based Resource Allocation for Content Distribution in IoT-Edge-Cloud Computing Environments

被引:12
|
作者
Cui, Tongke [1 ]
Yang, Ruopeng [1 ]
Fang, Chao [2 ]
Yu, Shui [3 ]
机构
[1] Natl Univ Def Technol, Coll Informat & Commun, Changsha 410073, Peoples R China
[2] Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
[3] Univ Technol Sydney, Sch Comp Sci, Sydney, NSW 2007, Australia
来源
SYMMETRY-BASEL | 2023年 / 15卷 / 01期
基金
北京市自然科学基金;
关键词
cloud-edge cooperation; queuing theory; deep reinforcement learning; in-networking caching; content popularity; COLLABORATIVE CLOUD; CHINESE FAMINE; EARLY-LIFE; ENERGY; ARCHITECTURE; VEHICLES; TRANSMISSION; MANAGEMENT; EXPOSURE; INTERNET;
D O I
10.3390/sym15010217
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
With the emergence of intelligent terminals, the Internet of Vehicles (IoV) has been drawing great attention by taking advantage of mobile communication technologies. However, high computation complexity, collaboration communication overhead and limited network bandwidths bring severe challenges to the provision of latency-sensitive IoV services. To overcome these problems, we design a cloud-edge cooperative content-delivery strategy in asymmetrical IoV environments to minimize network latency by providing optimal computing, caching and communication resource allocation. We abstract the joint allocation issue of heterogeneous resources as a queuing theory-based latency minimization objective. Next, a new deep reinforcement learning (DRL) scheme works in each network node to achieve optimal content caching and request routing on the basis of the perceptive request history and network state. Extensive simulations show that our proposed strategy has lower network latency compared with the current solutions in the cloud-edge collaboration system and converges fast under different scenarios.
引用
收藏
页数:17
相关论文
共 50 条
  • [41] A Decentralized Resource Allocation in Edge Computing for Secure IoT Environments
    Sasikumar, A.
    Ravi, Logesh
    Devarajan, Malathi
    Vairavasundaram, Subramaniyaswamy
    Selvalakshmi, A.
    Kotecha, Ketan
    Abraham, Ajith
    IEEE ACCESS, 2023, 11 : 117177 - 117189
  • [42] Smart Resource Allocation for Mobile Edge Computing: A Deep Reinforcement Learning Approach
    Wang, Jiadai
    Zhao, Lei
    Liu, Jiajia
    Kato, Nei
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2021, 9 (03) : 1529 - 1541
  • [43] Deep Reinforcement Learning for Offloading and Resource Allocation in Vehicle Edge Computing and Networks
    Liu, Yi
    Yu, Huimin
    Xie, Shengli
    Zhang, Yan
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (11) : 11158 - 11168
  • [44] Smart Resource Allocation for Mobile Edge Computing: A Deep Reinforcement Learning Approach
    Liu, Jiajia (liujiajia@nwpu.edu.cn), 1600, IEEE Computer Society (09):
  • [45] A Meta Reinforcement Learning-Based Task Offloading Strategy for IoT Devices in an Edge Cloud Computing Environment
    Yang, He
    Ding, Weichao
    Min, Qi
    Dai, Zhiming
    Jiang, Qingchao
    Gu, Chunhua
    APPLIED SCIENCES-BASEL, 2023, 13 (09):
  • [46] Deep Reinforcement Learning-Based Workload Scheduling for Edge Computing
    Zheng, Tao
    Wan, Jian
    Zhang, Jilin
    Jiang, Congfeng
    JOURNAL OF CLOUD COMPUTING-ADVANCES SYSTEMS AND APPLICATIONS, 2022, 11 (01):
  • [47] Deep Reinforcement Learning-Based Workload Scheduling for Edge Computing
    Tao Zheng
    Jian Wan
    Jilin Zhang
    Congfeng Jiang
    Journal of Cloud Computing, 11
  • [48] Fuzzy Reinforcement Learning based Microservice Allocation in Cloud Computing Environments
    Joseph, Christina Terese
    Martin, John Paul
    Chandrasekaran, K.
    Kandasamy, A.
    PROCEEDINGS OF THE 2019 IEEE REGION 10 CONFERENCE (TENCON 2019): TECHNOLOGY, KNOWLEDGE, AND SOCIETY, 2019, : 1541 - 1545
  • [49] Deep reinforcement learning-based methods for resource scheduling in cloud computing: a review and future directions
    Zhou, Guangyao
    Tian, Wenhong
    Buyya, Rajkumar
    Xue, Ruini
    Song, Liang
    ARTIFICIAL INTELLIGENCE REVIEW, 2024, 57 (05)
  • [50] Learning-Based Context-Aware Resource Allocation for Edge-Computing-Empowered Industrial IoT
    Liao, Haijun
    Zhou, Zhenyu
    Zhao, Xiongwen
    Zhang, Lei
    Mumtaz, Shahid
    Jolfaei, Alireza
    Ahmed, Syed Hassan
    Bashir, Ali Kashif
    IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (05) : 4260 - 4277