MTDB: an LSM-tree-based key-value store using a multi-tree structure to improve read performance

被引:0
|
作者
Lin, Xinwei [1 ,2 ]
Pan, Yubiao [1 ,2 ]
Feng, Wenjuan [1 ]
Zhang, Huizhen [1 ]
Lin, Mingwei [3 ]
机构
[1] Huaqiao Univ, Sch Comp Sci & Technol, Xiamen 361021, Fujian, Peoples R China
[2] Xiamen Key Lab Data Secur & Blockchain Technol, Data Secur Dept, Xiamen 361021, Fujian, Peoples R China
[3] Fujian Normal Univ, Coll Math & Informat, Fuzhou 350000, Fujian, Peoples R China
来源
JOURNAL OF SUPERCOMPUTING | 2024年 / 80卷 / 16期
关键词
Key-value store; Storage system; LSM-tree; Read amplification; Write amplification;
D O I
10.1007/s11227-024-06382-5
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional LSM-tree-based key-value storage systems face significant read amplification issues due to the multi-level structure of LSM-tree, the unordered SSTable files in Level 0, and the lack of an in-memory index structure for key-value pairs. We observed that, under the influence of workloads with locality features, key-value pairs exhibit a range-specific access intensity. Addressing the three reasons for LSM-tree read amplification, we have utilized the range-specific access intensity of workload to propose a multi-tree structure consisting of a B+ tree, a single-level hot tree, and an LSM-tree with partition-based Level 0. This aims to enhance the read performance of LSM-tree-based key-value storage systems. We designed the prototype, MTDB, based on LevelDB. The experimental results show that MTDB's read performance is 1.62x to 2.02x that of LevelDB, and it approaches or exceeds the read performance of KVell and Bourbon while reducing memory overhead by 58.85%-86%.
引用
收藏
页码:23995 / 24025
页数:31
相关论文
共 50 条
  • [31] HaLSM: A Hotspot-aware LSM-tree based Key-Value Storage Engine
    Zhang, Jianshun
    Wang, Fang
    Dong, Chao
    2022 IEEE 40TH INTERNATIONAL CONFERENCE ON COMPUTER DESIGN (ICCD 2022), 2022, : 179 - 186
  • [32] Coordinating Compaction between LSM-tree based Key-Value Stores for Edge Federation
    Kim, Jeeseob
    Yoo, Honghyeon
    Lee, Seungjae
    Byun, Hongsu
    Park, Sungyong
    2024 IEEE 17TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING, CLOUD 2024, 2024, : 419 - 429
  • [33] ThanosKV: A Holistic Approach to Utilize NVM for LSM-tree based Key-Value Stores
    Zhao, Guangxun
    Shin, Hojin
    Yoo, Seehwan
    Cho, Seong-je
    Choi, Jongmoo
    2024 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING, IEEE BIGCOMP 2024, 2024, : 143 - 150
  • [34] FPGA-based Compaction Engine for Accelerating LSM-tree Key-Value Stores
    Sun, Xuan
    Yu, Jinghuan
    Zhou, Zimeng
    Xue, Chun Jason
    2020 IEEE 36TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2020), 2020, : 1261 - 1272
  • [35] FPGA-Accelerated Compactions for LSM-based Key-Value Store
    Zhang, Teng
    Wang, Jianying
    Cheng, Xuntao
    Xu, Hao
    Yu, Nanlong
    Huang, Gui
    Zhang, Tieying
    He, Dengcheng
    Li, Feifei
    Cao, Wei
    Huang, Zhongdong
    Sun, Jianling
    PROCEEDINGS OF THE 18TH USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES, 2020, : 225 - 237
  • [36] ACaZoo: A Distributed Key-Value Store based on Replicated LSM-Trees
    Garefalakis, Panagiotis
    Papadopoulos, Panagiotis
    Magoutis, Kostas
    2014 IEEE 33RD INTERNATIONAL SYMPOSIUM ON RELIABLE DISTRIBUTED SYSTEMS (SRDS), 2014, : 211 - 220
  • [37] PLDB: Protecting LSM-based Key-Value Store using Trusted Execution Environment
    Shen, Chenkai
    Fan, Lei
    2023 IEEE 22ND INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS, TRUSTCOM, BIGDATASE, CSE, EUC, ISCI 2023, 2024, : 762 - 771
  • [38] iLSM-SSD: An Intelligent LSM-tree based Key-Value SSD for Data Analytics
    Lee, Chang-Gyu
    Kang, Hyeongu
    Park, Donggyu
    Park, Sungyong
    Kim, Youngjae
    Noh, Jungki
    Chung, Woosuk
    Park, Kyoung
    2019 IEEE 27TH INTERNATIONAL SYMPOSIUM ON MODELING, ANALYSIS, AND SIMULATION OF COMPUTER AND TELECOMMUNICATION SYSTEMS (MASCOTS 2019), 2019, : 384 - 395
  • [39] Improving LSM-Tree Based Key-Value Stores With Fine-Grained Compaction Mechanism
    Sun, Hui
    Chen, Guanzhong
    Yue, Yinliang
    Qin, Xiao
    IEEE TRANSACTIONS ON CLOUD COMPUTING, 2023, 11 (04) : 3778 - 3796
  • [40] Leveraging NVMe SSDs for Building a Fast, Cost-effective, LSM-tree-based KV Store
    Li, Cheng
    Chen, Hao
    Ruan, Chaoyi
    Ma, Xiaosong
    Xu, Yinlong
    ACM TRANSACTIONS ON STORAGE, 2021, 17 (04)