Coded Caching With Distributed Storage

被引:15
|
作者
Luo, Tianqiong [1 ]
Aggarwal, Vaneet [2 ]
Peleato, Borja [2 ]
机构
[1] Google Inc, Mountain View, CA 94043 USA
[2] Purdue Univ, Sch Elect & Comp Engn, W Lafayette, IN 47907 USA
关键词
Coded caching; storage system; RAID-4; RAID-6; erasure codes;
D O I
10.1109/TIT.2019.2940979
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Content delivery networks store information distributed across multiple servers, so as to balance the load and avoid unrecoverable losses in case of node or disk failures. Coded caching has been shown to be a useful technique which can reduce peak traffic rates by pre-fetching popular content at the end users and encoding transmissions so that different users can extract different information from the same packet. On one hand, distributed storage limits the capability of combining content from different servers into a single message, causing performance losses in coded caching schemes. But, on the other hand, the inherent redundancy existing in distributed storage systems can be used to improve the performance of those schemes through parallelism. This paper designs coded caching and delivery schemes tailored towards systems where the library is distributed across multiple servers, possibly with some redundancy in the form of maximum distance separable (MDS) erasure codes. Different schemes are proposed based on the capacity of the users' caches, as well as the number of parity servers. The main focus is on scenarios with one (RAID-4) or two (RAID-6) parity servers, but the paper also includes simple extensions for cases with more than two or no parity servers at all. The proposed schemes are shown to reduce the worst case latency, or equivalently the peak transmission rate from any server, below that of state-of-the-art algorithms.
引用
收藏
页码:7742 / 7755
页数:14
相关论文
共 50 条
  • [1] Optimal Caching for Low Latency in Distributed Coded Storage Systems
    Liu, Kaiyang
    Peng, Jun
    Wang, Jingrong
    Pan, Jianping
    [J]. IEEE-ACM TRANSACTIONS ON NETWORKING, 2022, 30 (03) : 1132 - 1145
  • [2] Sampling-Based Caching for Low Latency in Distributed Coded Storage Systems
    Liu, Kaiyang
    Wang, Jingrong
    Li, Heng
    Peng, Jun
    Pan, Jianping
    [J]. IEEE TRANSACTIONS ON SERVICES COMPUTING, 2023, 16 (06) : 4275 - 4287
  • [3] Coded Caching and Storage Planning in Heterogeneous Networks
    Vu, Thang X.
    Chatzinotas, Symeon
    Ottersten, Bjorn
    [J]. 2017 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2017,
  • [4] Popularity-based full replica caching for erasure-coded distributed storage systems
    Ruty, Guillaume
    Baccouch, Hana
    Nguyen, Victor
    Surcouf, Andre
    Rougier, Jean-Louis
    Boukhatem, Nadia
    [J]. CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2021, 24 (04): : 3173 - 3186
  • [5] Popularity-based full replica caching for erasure-coded distributed storage systems
    Guillaume Ruty
    Hana Baccouch
    Victor Nguyen
    André Surcouf
    Jean-Louis Rougier
    Nadia Boukhatem
    [J]. Cluster Computing, 2021, 24 : 3173 - 3186
  • [6] Correlation-Aware Distributed Caching and Coded Delivery
    Hassanzadeh, P.
    Tulino, A.
    Llorca, J.
    Erkip, E.
    [J]. 2016 IEEE INFORMATION THEORY WORKSHOP (ITW), 2016,
  • [7] Learning Distributed Coded Caching Strategy in a Cellular Network
    Doshi, Yash
    Bharath, B. N.
    Garg, Navneet
    Bhatia, Vimal
    Ratnarajah, Tharmalingam
    [J]. 2021 IEEE 93RD VEHICULAR TECHNOLOGY CONFERENCE (VTC2021-SPRING), 2021,
  • [8] Wireless Video Content Delivery through Coded Distributed Caching
    Golrezaei, Negin
    Shanmugam, Karthikeyan
    Dimakis, Alexandros G.
    Molisch, Andreas F.
    Caire, Giuseppe
    [J]. 2012 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2012, : 2467 - 2472
  • [9] Durable Network Coded Distributed Storage
    Abdrashitov, Vitaly
    Medard, Muriel
    [J]. 2015 53RD ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2015, : 851 - 856
  • [10] dCache, a distributed storage data caching system
    Ernst, M
    Fuhrmann, P
    Gasthuber, M
    Mkrtchyan, T
    Waldman, C
    [J]. PROCEEDINGS OF CHEP 2001, 2001, : 241 - 244