Q-learning based collaborative cache allocation in mobile edge computing

被引:40
|
作者
Chien, Wei-Che [1 ]
Weng, Hung-Yen [1 ]
Lai, Chin-Feng [1 ]
机构
[1] Natl Cheng Kung Univ, Dept Engn Sci, Tainan, Taiwan
关键词
Software defined networking (SDN); Artificial intelligence (AI); Collaborative cache problem; Q-learning; COMPUTATION; NETWORK; OPPORTUNITIES;
D O I
10.1016/j.future.2019.08.032
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The rapid development of Augmented Reality (AR), Virtual Reality(VR), Internet of Things (IoT), and high-definition video has caught the attention of low latency and high bandwidth network requirements. For huge data transmission, cache technology has been regarded as an effective solution for reducing transmission time from users to remote clouds. However, the increasing variety of cached data has caused the challenge of cache performance. Based on high flexibility, scalability, and deployability of the characteristics of Software-Defined Networking (SDN), this study proposes a collaborative cache mechanism in multiple Remote Radio Heads (RRHs) to multiple Baseband Units (BBUs). In addition, the traditional rule-based and metaheuristics methods are difficult to consider all environmental factors. To reduce the traffic load of backhaul and transmission latency from the remote cloud, we use Q-learning to design the cache mechanism and propose an action selection strategy for the cache problem. Through reinforcement learning to find the appropriate cache state. The simulation results show that the proposed method can effectively improve the cache performance. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:603 / 610
页数:8
相关论文
共 50 条
  • [31] A Deep Reinforcement Learning Approach for Collaborative Mobile Edge Computing
    Wu, Jiaqi
    Lin, Huang
    Liu, Huaize
    Gao, Lin
    [J]. IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 601 - 606
  • [32] Energy-Efficient Resource Allocation for Cache-Assisted Mobile Edge Computing
    Cui, Ying
    He, Wen
    Ni, Chun
    Guo, Chengjun
    Liu, Zhi
    [J]. 2017 IEEE 42ND CONFERENCE ON LOCAL COMPUTER NETWORKS (LCN), 2017, : 640 - 648
  • [33] Deep reinforcement learning for dynamic computation offloading and resource allocation in cache-assisted mobile edge computing systems
    Walmart Inc., Bentonville
    AR
    72716, United States
    不详
    AR
    72701, United States
    [J]. Intell. Converg. Netw., 2020, 2 (181-198): : 181 - 198
  • [34] Smart collaborative optimizations strategy for mobile edge computing based on deep reinforcement learning
    Fang, Juan
    Zhang, Mengyuan
    Ye, Zhiyuan
    Shi, Jiamei
    Wei, Jianhua
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2021, 96
  • [35] Reinforcement Learning Based Energy-Efficient Collaborative Inference for Mobile Edge Computing
    Xiao, Yilin
    Xiao, Liang
    Wan, Kunpeng
    Yang, Helin
    Zhang, Yi
    Wu, Yi
    Zhang, Yanyong
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 2023, 71 (02) : 864 - 876
  • [36] Collaborative cache allocation and task scheduling for data-intensive applications in edge computing environment
    Li Chunlin
    Tang Jianhang
    Tang, Hengliang
    Luo, Youlong
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2019, 95 : 249 - 264
  • [37] Task Offloading and Resource Allocation Strategy Based on Deep Learning for Mobile Edge Computing
    Yu, Zijia
    Xu, Xu
    Zhou, Wei
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [38] Q-Learning Algorithm for Joint Computation Offloading and Resource Allocation in Edge Cloud
    Dab, Boutheina
    Aitsaadi, Nadjib
    Langar, Rami
    [J]. 2019 IFIP/IEEE SYMPOSIUM ON INTEGRATED NETWORK AND SERVICE MANAGEMENT (IM), 2019,
  • [39] Mobile robot Navigation Based on Q-Learning Technique
    Khriji, Lazhar
    Touati, Farid
    Benhmed, Kamel
    Al-Yahmedi, Amur
    [J]. INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2011, 8 (01): : 45 - 51
  • [40] Computing Resource Allocation for Blockchain-Based Mobile Edge Computing
    Zhang, Wanbo
    Fan, Yuqi
    Zhang, Jun
    Ding, Xu
    Kim, Jung Yoon
    [J]. CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2024, 140 (01): : 863 - 885