Building Write-Optimized Tree Indexes on Disaggregated Memory

被引:42
|
作者
Wang, Qing [1 ]
Lu, Youyou [1 ]
Shu, Jiwu [1 ]
机构
[1] Tsinghua Univ, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
DISTRIBUTED TRANSACTIONS;
D O I
10.1145/3514221.3517824
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Memory disaggregation architecture physically separates CPU and memory into independent components, which are connected via high-speed RDMA networks, greatly improving resource utilization of database systems. However, such an architecture poses unique challenges to data indexing due to limited RDMA semantics and near-zero computation power at memory side. Existing indexes supporting disaggregated memory either suffer from low write performance, or require hardware modification. We present Sherman, a write-optimized B(+)Tree index on disaggregated memory that delivers high performance with commodity RDMA NICs. Sherman combines RDMA hardware features and RDMA-friendly software techniques to boost index write performance from three angles. First, to reduce round trips, Sherman coalesces dependent RDMA commands by leveraging in-order delivery property of RDMA. Second, to accelerate concurrent accesses, Sherman introduces a hierarchical lock that exploits on-chip memory of RDMA NICs. Finally, to mitigate write amplification, Sherman tailors the data structure layout of B+ Tree with a two-level version mechanism. Our evaluation shows that, Sherman is one order of magnitude faster in terms of both throughput and 99th percentile latency on typical writeintensive workloads, compared with state-of-the-art designs.
引用
收藏
页码:45 / 52
页数:8
相关论文
共 50 条
  • [1] Sherman: A Write-Optimized Distributed B+Tree Index on Disaggregated Memory
    Wang, Qing
    Lu, Youyou
    Shu, Jiwu
    PROCEEDINGS OF THE 2022 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA (SIGMOD '22), 2022, : 1033 - 1048
  • [2] Technical Perspective for Sherman: A Write-Optimized Distributed B plus Tree Index on Disaggregated Memory
    Kraska, Tim
    SIGMOD RECORD, 2023, 52 (01) : 44 - 44
  • [3] A Scalable and Write-Optimized Disaggregated B+-Tree With Adaptive Cache Assistance
    An, Hang
    Wang, Fang
    Feng, Dan
    Zou, Xiaomin
    Liu, Zefeng
    Zhang, Jianshun
    IEEE TRANSACTIONS ON CLOUD COMPUTING, 2024, 12 (04) : 1074 - 1087
  • [4] A highly write-optimized concurrent B plus -tree for persistent memory
    Yan, Wei
    Zhang, Xingjun
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 155 : 219 - 230
  • [5] Write-Optimized B+ Tree Index Technology for Persistent Memory
    Ma, Rui-Xiang
    Wu, Fei
    Dong, Bu-Rong
    Zhang, Meng
    Li, Wei-Jun
    Xie, Chang-Sheng
    JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2021, 36 (05) : 1037 - 1050
  • [6] Write-Optimized B+ Tree Index Technology for Persistent Memory
    Rui-Xiang Ma
    Fei Wu
    Bu-Rong Dong
    Meng Zhang
    Wei-Jun Li
    Chang-Sheng Xie
    Journal of Computer Science and Technology, 2021, 36 : 1037 - 1050
  • [7] A Write-Optimized B-Tree Layer for NAND Flash Memory
    Gong, Xiaona
    Chen, Shuyu
    Lin, Mingwei
    Liu, Haozhang
    2011 7TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, NETWORKING AND MOBILE COMPUTING (WICOM), 2011,
  • [8] Write-Optimized Dynamic Hashing for Persistent Memory
    Nam, Moohyeon
    Cha, Hokeun
    Choi, Young-ri
    Noh, Sam H.
    Nam, Beomseok
    PROCEEDINGS OF THE 17TH USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES, 2019, : 31 - 44
  • [9] TLBtree: A Read/Write-Optimized Tree Index for Non-Volatile Memory
    Luo, Yongping
    Jin, Peiquan
    Zhang, Qinglin
    Cheng, Bin
    2021 IEEE 37TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2021), 2021, : 1889 - 1894
  • [10] WOBTree: a write-optimized B plus -tree for non-volatile memory
    Wang, Haitao
    Li, Zhanhuai
    Zhang, Xiao
    Zhao, Xiaonan
    Jiang, Song
    FRONTIERS OF COMPUTER SCIENCE, 2021, 15 (05)