Modified reinforcement learning based-caching system for mobile edge computing

被引:2
|
作者
Mehamel, Sarra [1 ,2 ]
Bouzefrane, Samia [2 ]
Banarjee, Soumya [2 ]
Daoui, Mehammed [1 ]
Balas, Valentina E. [3 ]
机构
[1] Univ Mouloud Mammeri Tizi Ouzou, Tizi Ouzou, Algeria
[2] Conservatoire Natl Arts & Metiers, Paris, France
[3] Aurel Vlaicu Univ Arad, Arad, Romania
来源
关键词
Caching; reinforcement learning; fuzzy logic; mobile edge computing;
D O I
10.3233/IDT-190152
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Caching contents at the edge of mobile networks is an efficient mechanism that can alleviate the backhaul links load and reduce the transmission delay. For this purpose, choosing an adequate caching strategy becomes an important issue. Recently, the tremendous growth of Mobile Edge Computing (MEC) empowers the edge network nodes with more computation capabilities and storage capabilities, allowing the execution of resource-intensive tasks within the mobile network edges such as running artificial intelligence (AI) algorithms. Exploiting users context information intelligently makes it possible to design an intelligent context-aware mobile edge caching. To maximize the caching performance, the suitable methodology is to consider both context awareness and intelligence so that the caching strategy is aware of the environment while caching the appropriate content by making the right decision. Inspired by the success of reinforcement learning (RL) that uses agents to deal with decision making problems, we present a modified reinforcement learning (mRL) to cache contents in the network edges. Our proposed solution aims to maximize the cache hit rate and requires a multi awareness of the influencing factors on cache performance. The modified RL differs from other RL algorithms in the learning rate that uses the method of stochastic gradient decent (SGD) beside taking advantage of learning using the optimal caching decision obtained from fuzzy rules.
引用
收藏
页码:537 / 552
页数:16
相关论文
共 50 条
  • [1] Reinforcement Learning-Based Optimal Computing and Caching in Mobile Edge Network
    Qian, Yichen
    Wang, Rui
    Wu, Jun
    Tan, Bin
    Ren, Haoqi
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2020, 38 (10) : 2343 - 2355
  • [2] Multi-Agent Reinforcement Learning Based File Caching Strategy in Mobile Edge Computing
    Yang, Yongjian
    Lou, Kaihao
    Wang, En
    Liu, Wenbin
    Shang, Jianwen
    Song, Xueting
    Li, Dawei
    Wu, Jie
    [J]. IEEE-ACM TRANSACTIONS ON NETWORKING, 2023, 31 (06) : 3159 - 3174
  • [3] Deep Reinforcement Learning-based computation offloading and distributed edge service caching for Mobile Edge Computing
    Xie, Mande
    Ye, Jiefeng
    Zhang, Guoping
    Ni, Xueping
    [J]. COMPUTER NETWORKS, 2024, 250
  • [4] SECURITY IN MOBILE EDGE CACHING WITH REINFORCEMENT LEARNING
    Xiao, Liang
    Wan, Xiaoyue
    Dai, Canhuang
    Du, Xiaojiang
    Chen, Xiang
    Guizani, Mohsen
    [J]. IEEE WIRELESS COMMUNICATIONS, 2018, 25 (03) : 116 - 122
  • [5] Deep Reinforcement Learning-based Power and Caching Joint Optimal Allocation over Mobile Edge Computing
    Li, Xueting
    Yang, Hui
    Yao, Qiuyan
    Bao, Bowen
    Li, Jun
    Zhang, Jie
    [J]. 2020 IEEE INTERNATIONAL SYMPOSIUM ON BROADBAND MULTIMEDIA SYSTEMS AND BROADCASTING (BMSB), 2020,
  • [6] Offloading in Mobile Edge Computing Based on Federated Reinforcement Learning
    Dai, Yu
    Xue, Qing
    Gao, Zhen
    Zhang, Qiuhong
    Yang, Lei
    [J]. WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [7] Sharding for Blockchain based Mobile Edge Computing System: A Deep Reinforcement Learning Approach
    Yuan, Shijing
    Li, Jie
    Liang, Jinghao
    Zhu, Yuxuan
    Yu, Xiang
    Chen, Jianping
    Wu, Chentao
    [J]. 2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [8] Learning-Based Cooperative Content Caching Policy for Mobile Edge Computing
    Jiang, Wei
    Feng, Gang
    Qin, Shuang
    Liang, Ying-Chang
    [J]. ICC 2019 - 2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2019,
  • [9] EICache: A learning-based intelligent caching strategy in mobile edge computing
    Tang, Bing
    Kang, Linyao
    [J]. PEER-TO-PEER NETWORKING AND APPLICATIONS, 2022, 15 (02) : 934 - 949
  • [10] EICache: A learning-based intelligent caching strategy in mobile edge computing
    Bing Tang
    Linyao Kang
    [J]. Peer-to-Peer Networking and Applications, 2022, 15 : 934 - 949