MTDB: an LSM-tree-based key-value store using a multi-tree structure to improve read performance

被引:0
|
作者
Lin, Xinwei [1 ,2 ]
Pan, Yubiao [1 ,2 ]
Feng, Wenjuan [1 ]
Zhang, Huizhen [1 ]
Lin, Mingwei [3 ]
机构
[1] Huaqiao Univ, Sch Comp Sci & Technol, Xiamen 361021, Fujian, Peoples R China
[2] Xiamen Key Lab Data Secur & Blockchain Technol, Data Secur Dept, Xiamen 361021, Fujian, Peoples R China
[3] Fujian Normal Univ, Coll Math & Informat, Fuzhou 350000, Fujian, Peoples R China
来源
JOURNAL OF SUPERCOMPUTING | 2024年 / 80卷 / 16期
关键词
Key-value store; Storage system; LSM-tree; Read amplification; Write amplification;
D O I
10.1007/s11227-024-06382-5
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional LSM-tree-based key-value storage systems face significant read amplification issues due to the multi-level structure of LSM-tree, the unordered SSTable files in Level 0, and the lack of an in-memory index structure for key-value pairs. We observed that, under the influence of workloads with locality features, key-value pairs exhibit a range-specific access intensity. Addressing the three reasons for LSM-tree read amplification, we have utilized the range-specific access intensity of workload to propose a multi-tree structure consisting of a B+ tree, a single-level hot tree, and an LSM-tree with partition-based Level 0. This aims to enhance the read performance of LSM-tree-based key-value storage systems. We designed the prototype, MTDB, based on LevelDB. The experimental results show that MTDB's read performance is 1.62x to 2.02x that of LevelDB, and it approaches or exceeds the read performance of KVell and Bourbon while reducing memory overhead by 58.85%-86%.
引用
收藏
页码:23995 / 24025
页数:31
相关论文
共 50 条
  • [1] SplitDB: Closing the Performance Gap for LSM-Tree-Based Key-Value Stores
    Cai, Miao
    Jiang, Xuzhen
    Shen, Junru
    Ye, Baoliu
    IEEE TRANSACTIONS ON COMPUTERS, 2024, 73 (01) : 206 - 220
  • [2] CDNRocks: computable data nodes with RocksDB to improve the read performance of LSM-tree-based distributed key-value storage systems
    Huang, Feixiong
    Pan, Yubiao
    Zhang, Huizhen
    Lin, Mingwei
    JOURNAL OF SUPERCOMPUTING, 2025, 81 (01):
  • [3] SFM: Mitigating Read/Write Amplification Problem of LSM-Tree-Based Key-Value Stores
    Lee, Hoyoung
    Lee, Minho
    Eom, Young Ik
    IEEE ACCESS, 2021, 9 : 103153 - 103166
  • [4] Design of LSM-tree-based Key-value SSDs with Bounded Tails
    Im, Junsu
    Bae, Jinwook
    Chung, Chanwoo
    Arvind
    Lee, Sungjin
    ACM TRANSACTIONS ON STORAGE, 2021, 17 (02)
  • [5] Elevating Performance of LSM-Tree-Based Key-Value Stores with Gradient Data Hierarchy
    Sun, Hui
    Xu, Jinfeng
    Qin, Xiao
    2023 IEEE 16TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING, CLOUD, 2023, : 360 - 369
  • [6] gLSM: Using GPGPU to Accelerate Compactions in LSM-tree-based Key-value Stores
    Sun, Hui
    Xu, Jinfeng
    Jiang, Xiangxiang
    Chen, Guanzhong
    Yue, Yinliang
    Qin, Xiao
    ACM TRANSACTIONS ON STORAGE, 2024, 20 (01)
  • [7] A Performance Optimization Method for Key-Value Store Based on LSM-tree
    Wang H.
    Li Z.
    Zhang X.
    Zhao X.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2019, 56 (08): : 1792 - 1802
  • [8] Improving Write Performance for LSM-tree-based Key-Value Stores with NV-Cache
    Jiang, Xuzhen
    Cai, Miao
    Ye, Baotiu
    2022 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING, ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM, 2022, : 394 - 401
  • [9] Deduplication Triggered Compaction for LSM-tree Based Key-Value Store
    Zhang, Weitao
    Xu, Yinlong
    PROCEEDINGS OF 2018 IEEE 9TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS), 2018, : 719 - 722
  • [10] A Semantic-Integrated LSM-Tree-Based Key-Value Storage Engine for Blockchain Systems
    Wei, Qian
    Chen, Zehao
    Chen, Xiaowei
    Zhang, Yuhao
    Cai, Xiaojun
    Jia, Zhiping
    Shen, Zhaoyan
    Wang, Yi
    Shao, Zili
    Li, Bingzhe
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2024, 43 (06) : 1794 - 1807