SLRL: A Simple Least Remaining Lifetime File Eviction policy for HPC multi-tier storage systems

被引:1
|
作者
Nicolas, Louis-Marie [1 ]
Thomas, Luis [1 ]
Hadjadj-Aoul, Yassine [2 ]
Boukhobza, Jalil [1 ]
机构
[1] ENSTA Bretagne, Lab STICC, CNRS, UMR 6285, Brest, France
[2] Univ Rennes 1, IRISA, Rennes, Ille & Vilaine, France
关键词
Data placement; Multi-Tier Storage; File lifetime; High Performance Computing; Simulation; LRU;
D O I
10.1145/3503646.3524297
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
HPC systems are composed of multiple tiers of storage, from the top high performance tier (high speed SSDs) to the bottom capacitive one (tapes). File placement in such architecture is managed through prefetchers (bottom-up) and eviction policies (top-down). Most state-of-the-art work focus on the former while using algorithm flavors of LRU, LFU and FIFO for the latter. LRU was for long considered the best choice. However, recent studies has shown that the simplicity of FIFO could make it more scalable than LRU because of metadata management, and thus more adequate in several cases. In this paper, we propose a new eviction policy based on predicted files lifetimes. It is comparable to FIFO in terms of metadata overhead and simplicity (thus scalability), while giving a hit ratio comparable to LRU (or even 10% better for some tested traces). We also propose a naive multi-tier heterogeneous storage simulator implementation to evaluate such policies.
引用
收藏
页码:70 / 76
页数:7
相关论文
共 9 条
  • [1] SLRL: A Simple Least Remaining Lifetime File Eviction policy for HPC multi-tier storage systems
    Nicolas L.-M.
    Thomas L.
    Hadjadj-Aoul Y.
    Boukhobza J.
    Operating Systems Review (ACM), 2022, 56 (01): : 70 - 76
  • [2] Improving recoverability in multi-tier storage systems
    Aguilera, Marcos K.
    Keeton, Kimberly
    Merchant, Arif
    Muniswamy-Reddy, Kiran-Kumar
    Uysal, Mustafa
    37TH ANNUAL IEEE/IFIP INTERNATIONAL CONFERENCE ON DEPENDABLE SYSTEMS AND NETWORKS, PROCEEDINGS, 2007, : 677 - +
  • [3] Multi-tier Shuttle-based Storage and Retrieval Systems
    Lerher, Tone
    FME TRANSACTIONS, 2016, 44 (03): : 285 - 290
  • [4] EAD: elasticity aware deduplication manager for datacenters with multi-tier storage systems
    Yang, Zhengyu
    Wang, Yufeng
    Bhamini, Janki
    Tan, Chiu C.
    Mi, Ningfang
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2018, 21 (03): : 1561 - 1579
  • [5] EAD: elasticity aware deduplication manager for datacenters with multi-tier storage systems
    Zhengyu Yang
    Yufeng Wang
    Janki Bhamini
    Chiu C. Tan
    Ningfang Mi
    Cluster Computing, 2018, 21 : 1561 - 1579
  • [6] Repairable Fountain Coded Storage Systems for Multi-Tier Mobile Edge Caching Networks
    Wang, Ye
    Gu, Shushi
    Zhao, Lian
    Zhang, Ning
    Xiang, Wei
    Zhang, Qinyu
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2020, 7 (04): : 2310 - 2322
  • [7] Predicting file lifetimes for data placement in multi-Tiered storage systems for HPC
    Thomas L.
    Gougeaud S.
    Rubini S.
    Deniel P.
    Boukhobza J.
    Operating Systems Review (ACM), 2021, 55 (01): : 99 - 107
  • [8] Predicting file lifetimes for data placement in multi-tiered storage systems for HPC
    Thomas, Luis
    Gougeaud, Sebastien
    Rubini, Stephane
    Deniel, Philippe
    Boukhobza, Jalil
    OPERATING SYSTEMS REVIEW, 2021, 55 (01) : 99 - 107
  • [9] A multi-tier linking approach to analyze performance of autonomous vehicle-based storage and retrieval systems
    Roy, Debjit
    Krishnamurthy, Ananth
    Heragu, Sunderesh S.
    Malmborg, Charles
    COMPUTERS & OPERATIONS RESEARCH, 2017, 83 : 173 - 188