Q-learning based collaborative cache allocation in mobile edge computing

被引:40
|
作者
Chien, Wei-Che [1 ]
Weng, Hung-Yen [1 ]
Lai, Chin-Feng [1 ]
机构
[1] Natl Cheng Kung Univ, Dept Engn Sci, Tainan, Taiwan
关键词
Software defined networking (SDN); Artificial intelligence (AI); Collaborative cache problem; Q-learning; COMPUTATION; NETWORK; OPPORTUNITIES;
D O I
10.1016/j.future.2019.08.032
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The rapid development of Augmented Reality (AR), Virtual Reality(VR), Internet of Things (IoT), and high-definition video has caught the attention of low latency and high bandwidth network requirements. For huge data transmission, cache technology has been regarded as an effective solution for reducing transmission time from users to remote clouds. However, the increasing variety of cached data has caused the challenge of cache performance. Based on high flexibility, scalability, and deployability of the characteristics of Software-Defined Networking (SDN), this study proposes a collaborative cache mechanism in multiple Remote Radio Heads (RRHs) to multiple Baseband Units (BBUs). In addition, the traditional rule-based and metaheuristics methods are difficult to consider all environmental factors. To reduce the traffic load of backhaul and transmission latency from the remote cloud, we use Q-learning to design the cache mechanism and propose an action selection strategy for the cache problem. Through reinforcement learning to find the appropriate cache state. The simulation results show that the proposed method can effectively improve the cache performance. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:603 / 610
页数:8
相关论文
共 50 条
  • [1] Collaborative Cache Allocation and Computation Offloading in Mobile Edge Computing
    Ndikumana, Anselme
    Ullah, Saeed
    Tuan LeAnh
    Tran, Nguyen H.
    Hong, Choong Seon
    [J]. 2017 19TH ASIA-PACIFIC NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM (APNOMS 2017): MANAGING A WORLD OF THINGS, 2017, : 366 - 369
  • [2] Computation Offloading for Workflow in Mobile Edge Computing Based on Deep Q-Learning
    Zhu, Anqi
    Guo, Songtao
    Ma, Mingfang
    Feng, Hao
    Liu, Bei
    Su, Xin
    Guo, Minghong
    Jiang, Qiucen
    [J]. 2019 28TH WIRELESS AND OPTICAL COMMUNICATIONS CONFERENCE (WOCC), 2019, : 38 - 42
  • [3] Deep Q-Learning Based Computation Offloading Strategy for Mobile Edge Computing
    Wei, Yifei
    Wang, Zhaoying
    Guo, Da
    Yu, F. Richard
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2019, 59 (01): : 89 - 104
  • [4] A collaborative cache allocation strategy for performance and link cost in mobile edge computing
    Xiao, Hui
    Zhang, Xinyu
    Hu, Zhigang
    Zheng, Meiguang
    Liang, Yang
    [J]. JOURNAL OF SUPERCOMPUTING, 2024, 80 (15): : 22885 - 22912
  • [5] DoME: Dew computing based microservice execution in mobile edge using Q-learning
    Chakraborty, Sheuli
    De, Debashis
    Mazumdar, Kaushik
    [J]. APPLIED INTELLIGENCE, 2023, 53 (09) : 10917 - 10936
  • [6] DoME: Dew computing based microservice execution in mobile edge using Q-learning
    Sheuli Chakraborty
    Debashis De
    Kaushik Mazumdar
    [J]. Applied Intelligence, 2023, 53 : 10917 - 10936
  • [7] Cache allocation policy based on user preference using reinforcement learning in mobile edge computing
    Li, Nianxin
    Zhai, Linbo
    Song, Shudian
    Zhu, Xiumin
    Li, Yumei
    Yang, Feng
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2023, 36 (15):
  • [8] Load Balancing and Energy Saving Algorithm Based on Deep Q-Learning in Mobile Edge Computing
    Ma, Li
    Cui, Xinyu
    Li, Yang
    [J]. 2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 3736 - 3741
  • [9] A Q-learning based Method for Energy-Efficient Computation Offloading in Mobile Edge Computing
    Jiang, Kai
    Zhou, Huan
    Li, Dawei
    Liu, Xuxun
    Xu, Shouzhi
    [J]. 2020 29TH INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATIONS AND NETWORKS (ICCCN 2020), 2020,
  • [10] Q-Learning based SFC deployment on Edge Computing Environment
    Pandey, Suman
    Hong, James Won-Ki
    Yoo, Jae-Hyoung
    [J]. APNOMS 2020: 2020 21ST ASIA-PACIFIC NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM (APNOMS), 2020, : 220 - 226