Popularity-based full replica caching for erasure-coded distributed storage systems

被引:0
|
作者
Guillaume Ruty
Hana Baccouch
Victor Nguyen
André Surcouf
Jean-Louis Rougier
Nadia Boukhatem
机构
[1] Cisco Systems PIRL,LTCI
[2] Télécom Paris,undefined
来源
Cluster Computing | 2021年 / 24卷
关键词
Distributed storage systems; Object storage; Erasure codes; Caching;
D O I
暂无
中图分类号
学科分类号
摘要
In most storage systems, the storage nodes store data on a local filesystem. Thus, unless they have a dedicated caching layer, they benefit from the usual filesystem cache in the host’s free memory. However, in erasure-coded storage systems, caching is effective only if all the systematic fragments corresponding to an object are in the cache. In this work, we propose a new caching policy adapting traditional methods to erasure-coded storage systems. The main idea of our solution is to cache a full object rather than fragments object. A simulation-based evaluation showed that our full replica solution is able to improve the cache hit ratio and reduce the cache waste ratio compared to the traditional caching method. Moreover, experimental evaluation has been conducted. It indicates that our implementation not only validates the previous results but also shows that cache hits on full replicas have a better request response time.
引用
收藏
页码:3173 / 3186
页数:13
相关论文
共 50 条
  • [1] Popularity-based full replica caching for erasure-coded distributed storage systems
    Ruty, Guillaume
    Baccouch, Hana
    Nguyen, Victor
    Surcouf, Andre
    Rougier, Jean-Louis
    Boukhatem, Nadia
    [J]. CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2021, 24 (04): : 3173 - 3186
  • [2] Online Encoding for Erasure-Coded Distributed Storage Systems
    Xu, Fangliang
    Wang, Yijie
    Ma, Xingkong
    [J]. 2017 IEEE 37TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS WORKSHOPS (ICDCSW), 2017, : 338 - 342
  • [3] Data Management in Erasure-Coded Distributed Storage Systems
    Aatish, Chiniah
    Avinash, Mungur
    [J]. 2020 20TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND INTERNET COMPUTING (CCGRID 2020), 2020, : 902 - 907
  • [4] A popularity-aware reconstruction technique in erasure-coded storage systems
    Cao, Ting
    Peng, Xiaopu
    Zhang, Chaowei
    Al Tekreeti, Taha Khalid
    Mao, Jianzhou
    Qin, Xiao
    Huang, Jianzhong
    [J]. JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2020, 146 : 122 - 138
  • [5] Optimistic Erasure-Coded Distributed Storage
    Dutta, Partha
    Guerraoui, Rachid
    Levy, Ron R.
    [J]. DISTRIBUTED COMPUTING, PROCEEDINGS, 2008, 5218 : 182 - +
  • [6] Taming Tail Latency for Erasure-coded, Distributed Storage Systems
    Aggarwal, Vaneet
    Fan, Jingxian
    Lan, Tian
    [J]. IEEE INFOCOM 2017 - IEEE CONFERENCE ON COMPUTER COMMUNICATIONS, 2017,
  • [7] Mean Latency Optimization in Erasure-coded Distributed Storage Systems
    Al-Abbasi, Abubakr O.
    Aggarwal, Vaneet
    [J]. IEEE INFOCOM 2018 - IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (INFOCOM WKSHPS), 2018, : 432 - 437
  • [8] Fast Repair for Single Failure in Erasure-coded Distributed Storage Systems
    Zhang, Huayu
    Li, Hui
    Zhu, Bing
    Chen, Jun
    [J]. 2014 IEEE 33RD INTERNATIONAL SYMPOSIUM ON RELIABLE DISTRIBUTED SYSTEMS (SRDS), 2014, : 146 - 151
  • [9] Optimizing Erasure-Coded Data Archival for Replica-Based Storage Clusters
    Huang, Jianzhong
    Zhou, Panping
    Qin, Xiao
    Wang, Yanqun
    Xie, Changsheng
    [J]. COMPUTER JOURNAL, 2019, 62 (02): : 247 - 262
  • [10] Optimal resilience for erasure-coded Byzantine distributed storage
    Cachin, Christian
    Tessaro, Stefano
    [J]. DSN 2006 INTERNATIONAL CONFERENCE ON DEPENDABLE SYSTEMS AND NETWORKS, PROCEEDINGS, 2006, : 115 - 124