Collaborative Video Caching in the Edge Network using Deep Reinforcement Learning

被引:0
|
作者
Lekharu, Anirban [1 ]
Gupta, Pranav [1 ]
Sur, Aridit [1 ]
Patra, Moumita [2 ]
机构
[1] Indian Inst Technol Guwahati, Comp Sci & Engn, Gauhati, India
[2] Indian Inst Technol Guwahati, Gauhati, India
来源
关键词
Reinforcement learning; collaborative caching; content popularity; mobile edge computing;
D O I
10.1145/3664613
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the enormous growth in mobile data traffic over the 5G environment, Adaptive BitRate (ABR) video streaming has become a challenging problem. Recent advances in Mobile Edge Computing (MEC) technology make it feasible to use Base Stations (BSs) intelligently by network caching, popularity-based video streaming, and more. Additional computing resources on the edge node offer an opportunity to reduce network traffic on the backhaul links during peak traffic hours. More recently, it has been found in the literature that collaborative caching strategies between neighbouring BSs (i.e., MEC servers) make it more efficient to reduce backhaul traffic and network congestion and thus improve the viewer experience substantially. In this work, we propose a Reinforcement Learning (RL)-based collaborative caching mechanism in which the edge servers cooperate to serve the requested content from the end-users. Specifically, this research aims to improve the overall cache hit rate at the MEC, where the edge servers are clustered based on their geographic locations. This task is modelled as a multi-objective optimization problem and solved using an RL framework. In addition, a novel cache admission and eviction policy is defined by calculating the priority score of video segments in the clustered MEC mesh network.
引用
收藏
页数:26
相关论文
共 50 条
  • [1] Deep Reinforcement Learning Based Collaborative Mobile Edge Caching for Omnidirectional Video Streaming
    Tan, Zengjie
    Xu, Yuanyuan
    [J]. WIRELESS ALGORITHMS, SYSTEMS, AND APPLICATIONS, WASA 2021, PT I, 2021, 12937 : 453 - 464
  • [2] Collaborative Edge Caching and Transcoding for 360° Video Streaming Based on Deep Reinforcement Learning
    Yang, Taoyu
    Tan, Zengjie
    Xu, Yuanyuan
    Cai, Shuwen
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (24) : 25551 - 25564
  • [3] Collaborative Caching in Edge Computing via Federated Learning and Deep Reinforcement Learning
    Wang, Yali
    Chen, Jiachao
    [J]. WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [4] Partially Collaborative Edge Caching Based on Federated Deep Reinforcement Learning
    Lei, Meng
    Li, Qiang
    Ge, Xiaohu
    Pandharipande, Ashish
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (01) : 1389 - 1394
  • [5] Collaborative Edge Computing and Caching With Deep Reinforcement Learning Decision Agents
    Ren, Jianji
    Wang, Haichao
    Hou, Tingting
    Zheng, Shuai
    Tang, Chaosheng
    [J]. IEEE ACCESS, 2020, 8 : 120604 - 120612
  • [6] Personalized Collaborative Edge Caching With Federated Transfer Deep Reinforcement Learning
    Liu, Sanqiu
    Li, Qiang
    Pandharipande, Ashish
    Ge, Xiaohu
    [J]. IEEE COMMUNICATIONS LETTERS, 2024, 28 (09) : 2096 - 2100
  • [7] Intelligent Video Caching at Network Edge: A Multi-Agent Deep Reinforcement Learning Approach
    Wang, Fangxin
    Wang, Feng
    Liu, Jiangchuan
    Shea, Ryan
    Sun, Lifeng
    [J]. IEEE INFOCOM 2020 - IEEE CONFERENCE ON COMPUTER COMMUNICATIONS, 2020, : 2499 - 2508
  • [8] Collaborative caching relay algorithm based on recursive deep reinforcement learning in mobile vehicle edge network
    Wu, Honghai
    Wang, Baibing
    Ma, Huahong
    Xing, Ling
    [J]. AD HOC NETWORKS, 2024, 152
  • [9] MECC: A Mobile Edge Collaborative Caching Framework Empowered by Deep Reinforcement Learning
    Xu, Siya
    Liu, Xin
    Guo, Shaoyong
    Qiu, Xuesong
    Meng, Luoming
    [J]. IEEE NETWORK, 2021, 35 (04): : 176 - 183
  • [10] Deep Reinforcement Learning Empowered Edge Collaborative Caching Scheme for Internet of Vehicles
    Liu, Xin
    Xu, Siya
    Yang, Chao
    Wang, Zhili
    Zhang, Hao
    Chi, Jingye
    Li, Qinghan
    [J]. COMPUTER SYSTEMS SCIENCE AND ENGINEERING, 2022, 42 (01): : 271 - 287