Modified reinforcement learning based-caching system for mobile edge computing

被引:2
|
作者
Mehamel, Sarra [1 ,2 ]
Bouzefrane, Samia [2 ]
Banarjee, Soumya [2 ]
Daoui, Mehammed [1 ]
Balas, Valentina E. [3 ]
机构
[1] Univ Mouloud Mammeri Tizi Ouzou, Tizi Ouzou, Algeria
[2] Conservatoire Natl Arts & Metiers, Paris, France
[3] Aurel Vlaicu Univ Arad, Arad, Romania
来源
关键词
Caching; reinforcement learning; fuzzy logic; mobile edge computing;
D O I
10.3233/IDT-190152
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Caching contents at the edge of mobile networks is an efficient mechanism that can alleviate the backhaul links load and reduce the transmission delay. For this purpose, choosing an adequate caching strategy becomes an important issue. Recently, the tremendous growth of Mobile Edge Computing (MEC) empowers the edge network nodes with more computation capabilities and storage capabilities, allowing the execution of resource-intensive tasks within the mobile network edges such as running artificial intelligence (AI) algorithms. Exploiting users context information intelligently makes it possible to design an intelligent context-aware mobile edge caching. To maximize the caching performance, the suitable methodology is to consider both context awareness and intelligence so that the caching strategy is aware of the environment while caching the appropriate content by making the right decision. Inspired by the success of reinforcement learning (RL) that uses agents to deal with decision making problems, we present a modified reinforcement learning (mRL) to cache contents in the network edges. Our proposed solution aims to maximize the cache hit rate and requires a multi awareness of the influencing factors on cache performance. The modified RL differs from other RL algorithms in the learning rate that uses the method of stochastic gradient decent (SGD) beside taking advantage of learning using the optimal caching decision obtained from fuzzy rules.
引用
收藏
页码:537 / 552
页数:16
相关论文
共 50 条
  • [41] Task Offloading Optimization in Mobile Edge Computing based on Deep Reinforcement Learning
    Silva, Carlos
    Magaia, Naercio
    Grilo, Antonio
    [J]. PROCEEDINGS OF THE INT'L ACM CONFERENCE ON MODELING, ANALYSIS AND SIMULATION OF WIRELESS AND MOBILE SYSTEMS, MSWIM 2023, 2023, : 109 - 118
  • [42] Proactive content caching by exploiting transfer learning for mobile edge computing
    Hou, Tingting
    Feng, Gang
    Qin, Shuang
    Jiang, Wei
    [J]. INTERNATIONAL JOURNAL OF COMMUNICATION SYSTEMS, 2018, 31 (11)
  • [43] Proactive Content Caching by Exploiting Transfer Learning for Mobile Edge Computing
    Hou, Tingting
    Feng, Gang
    Qin, Shuang
    Jiang, Wei
    [J]. GLOBECOM 2017 - 2017 IEEE GLOBAL COMMUNICATIONS CONFERENCE, 2017,
  • [44] Dynamic and intelligent edge server placement based on deep reinforcement learning in mobile edge computing
    Jiang, Xiaohan
    Hou, Peng
    Zhu, Hongbin
    Li, Bo
    Wang, Zongshan
    Ding, Hongwei
    [J]. AD HOC NETWORKS, 2023, 145
  • [45] Smart caching based on user behavior for mobile edge computing
    Zeng, Yuanyuan
    Xie, Jing
    Jiang, Hao
    Huang, Guohao
    Yi, Shuwen
    Xiong, Naixue
    Li, Jiazhi
    [J]. INFORMATION SCIENCES, 2019, 503 : 444 - 468
  • [46] Multi-Agent Reinforcement Learning Based Cooperative Content Caching for Mobile Edge Networks
    Jiang, Wei
    Feng, Gang
    Qin, Shuang
    Liu, Yijing
    [J]. IEEE ACCESS, 2019, 7 : 61856 - 61867
  • [47] Proactive Content Caching Based on Actor-Critic Reinforcement Learning for Mobile Edge Networks
    Jiang, Wei
    Feng, Daquan
    Sun, Yao
    Feng, Gang
    Wang, Zhenzhong
    Xia, Xiang-Gen
    [J]. IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2022, 8 (02) : 1239 - 1252
  • [48] Deep reinforcement learning-based task offloading and service migrating policies in service caching-assisted mobile edge computing
    Ke, Hongchang
    Hui, Wan
    Sun, Hongbin
    Yan, Halvin
    [J]. CHINA COMMUNICATIONS, 2024, 21 (04) : 88 - 103
  • [49] Deep Reinforcement Learning-Based Task Offloading and Service Migrating Policies in Service Caching-Assisted Mobile Edge Computing
    Ke Hongchang
    Wang Hui
    Sun Hongbin
    Halvin Yang
    [J]. China Communications, 2024, 21 (04) : 88 - 103
  • [50] Deep Reinforcement Learning (DRL)-Based Device-to-Device (D2D) Caching With Blockchain and Mobile Edge Computing
    Zhang, Ran
    Yu, F. Richard
    Liu, Jiang
    Huang, Tao
    Liu, Yunjie
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (10) : 6469 - 6485