Tiered Storage in Modern Key-Value Stores: Performance, Storage-Efficiency, and Cost-Efficiency Considerations

被引:1
|
作者
Jaranilla, Charles [1 ]
Shin, Hojin [1 ]
Yoo, Seehwan [1 ]
Cho, Seong-Je [1 ]
Choi, Jongmoo [1 ]
机构
[1] Dankook Univ, Dept Software, Yongin, South Korea
基金
新加坡国家研究基金会;
关键词
Tiered storage; SSD; key-value store; compression; analysis;
D O I
10.1109/BigComp60711.2024.00032
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The emergence of big data has experienced a significant increase in both the variety and volume of data which prompted the development of faster, more reliable storage solutions. The primary objective of this study is to investigate how varying latencies of diverse storage media impact the performance of a representative KVS in RocksDB and to ascertain whether employing lower-cost storage media at the bottom levels can lead to efficient space utilization and cost savings. We implement tiered SSD storage into RocksDB to analyze the trade-offs in employing a diversified setup. Our findings reveal that, despite differences in latency, RocksDB demonstrates remarkable resilience in mitigating the impact of latency variations. Furthermore, to facilitate better storage utilization, we take advantage of RocksDB's flexibility by utilizing different compression techniques in tiered storage while considering their characteristics. Results show that while our strategy does not overcome the performance of Optane SSD, it has a negligible difference with NVMe SSD in terms of write and read throughput. With hybrid compression, compared to SATA SSD, the tiered storage demonstrates a difference of 13.8 MBps in write and 3.86 MBps in read workloads. It also provides a cost-efficient storage option with cost similar to that of SATA SSD but with performance comparable to NVMe SSD. This research offers valuable guidance for organizations aiming to optimize their storage infrastructure and reduce storage upgrade costs while maintaining database efficiency.
引用
收藏
页码:151 / 158
页数:8
相关论文
共 31 条
  • [31] Development of key performance indicators for CO2 storage operability and efficiency assessment: Application to the Southern North Sea Rotliegend Group
    Korre, Anna
    Durucan, Sevket
    Shi, Ji-Quan
    Syed, Amer
    Govindan, Rajesh
    Hannis, Sarah
    Williams, John
    Kirby, Gary
    Quinn, Martyn
    GHGT-11, 2013, 37 : 4894 - 4901