MTDB: an LSM-tree-based key-value store using a multi-tree structure to improve read performance

被引:0
|
作者
Lin, Xinwei [1 ,2 ]
Pan, Yubiao [1 ,2 ]
Feng, Wenjuan [1 ]
Zhang, Huizhen [1 ]
Lin, Mingwei [3 ]
机构
[1] Huaqiao Univ, Sch Comp Sci & Technol, Xiamen 361021, Fujian, Peoples R China
[2] Xiamen Key Lab Data Secur & Blockchain Technol, Data Secur Dept, Xiamen 361021, Fujian, Peoples R China
[3] Fujian Normal Univ, Coll Math & Informat, Fuzhou 350000, Fujian, Peoples R China
来源
JOURNAL OF SUPERCOMPUTING | 2024年 / 80卷 / 16期
关键词
Key-value store; Storage system; LSM-tree; Read amplification; Write amplification;
D O I
10.1007/s11227-024-06382-5
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional LSM-tree-based key-value storage systems face significant read amplification issues due to the multi-level structure of LSM-tree, the unordered SSTable files in Level 0, and the lack of an in-memory index structure for key-value pairs. We observed that, under the influence of workloads with locality features, key-value pairs exhibit a range-specific access intensity. Addressing the three reasons for LSM-tree read amplification, we have utilized the range-specific access intensity of workload to propose a multi-tree structure consisting of a B+ tree, a single-level hot tree, and an LSM-tree with partition-based Level 0. This aims to enhance the read performance of LSM-tree-based key-value storage systems. We designed the prototype, MTDB, based on LevelDB. The experimental results show that MTDB's read performance is 1.62x to 2.02x that of LevelDB, and it approaches or exceeds the read performance of KVell and Bourbon while reducing memory overhead by 58.85%-86%.
引用
收藏
页码:23995 / 24025
页数:31
相关论文
共 50 条
  • [41] Block-LSM: An Ether-aware Block-ordered LSM-tree based Key-Value Storage Engine
    Chen, Zehao
    Li, Bingzhe
    Cai, Xiaojun
    Jia, Zhiping
    Shen, Zhaoyan
    Wang, Yi
    Shao, Zili
    2021 IEEE 39TH INTERNATIONAL CONFERENCE ON COMPUTER DESIGN (ICCD 2021), 2021, : 25 - 32
  • [42] Forest of Distributed B plus Tree Based on Key-Value Store for Big-Set Problem
    Thanh Trung Nguyen
    Minh Hieu Nguyen
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2016, 2016, 9645 : 268 - 282
  • [43] Building an Efficient Put-Intensive Key-Value Store with Skip-Tree
    Yue, Yinliang
    He, Bingsheng
    Li, Yuzhe
    Wang, Weiping
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2017, 28 (04) : 961 - 973
  • [44] Dhcache: a dual-hash cache for optimizing the read performance in key-value store
    Lu, Jinkang
    Lv, Meng
    Li, Peixuan
    Yuan, Zhu
    Xie, Ping
    JOURNAL OF SUPERCOMPUTING, 2025, 81 (02):
  • [45] Compaction-Aware Zone Allocation for LSM based Key-Value Store on ZNS SSDs
    Lee, Hee-Rock
    Lee, Chang-Gyu
    Lee, Seungjin
    Kim, Youngjae
    PROCEEDINGS OF THE 2022 14TH ACM WORKSHOP ON HOT TOPICS IN STORAGE AND FILE SYSTEMS, HOTSTORAGE 2022, 2022, : 93 - 99
  • [46] Re-LSM: A ReRAM-based Processing-in-Memory Framework for LSM-based Key-Value Store
    Wei, Qian
    Shen, Zhaoyan
    Tong, Yiheng
    Jia, Zhiping
    Ju, Lei
    Chen, Jiezhi
    Li, Bingzhe
    2022 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER AIDED DESIGN, ICCAD, 2022,
  • [47] A Low-Latency Multi-Version Key-Value Store Using B-tree on an FPGA-CPU Platform
    Ren, Yuchen
    Xie, Jinyu
    Qiu, Yunhui
    Lv, Hankun
    Yin, Wenbo
    Wang, Lingli
    Yu, Bowei
    Chen, Hua
    He, Xianjun
    Liao, Zhijian
    Shi, Xiaozhong
    2019 29TH INTERNATIONAL CONFERENCE ON FIELD-PROGRAMMABLE LOGIC AND APPLICATIONS (FPL), 2019, : 321 - 325
  • [48] NVLSM: A Persistent Memory Key-Value Store Using Log-Structured Merge Tree with Accumulative Compaction
    Zhang, Baoquan
    Du, David H. C.
    ACM TRANSACTIONS ON STORAGE, 2021, 17 (03)
  • [49] Adaptive Lower-Level Driven Compaction to Optimize LSM-Tree Key-Value Stores
    Chai, Yunpeng
    Chai, Yanfeng
    Wang, Xin
    Wei, Haocheng
    Wang, Yangyang
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (06) : 2595 - 2609
  • [50] Boosting Compaction in B-Tree Based Key-Value Store by Exploiting Parallel Reads in Flash SSDs
    Lee, Jongbaeg
    Oh, Gihwan
    Lee, Sang-Won
    IEEE ACCESS, 2021, 9 : 56344 - 56353