Building Write-Optimized Tree Indexes on Disaggregated Memory

被引:42
|
作者
Wang, Qing [1 ]
Lu, Youyou [1 ]
Shu, Jiwu [1 ]
机构
[1] Tsinghua Univ, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
DISTRIBUTED TRANSACTIONS;
D O I
10.1145/3514221.3517824
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Memory disaggregation architecture physically separates CPU and memory into independent components, which are connected via high-speed RDMA networks, greatly improving resource utilization of database systems. However, such an architecture poses unique challenges to data indexing due to limited RDMA semantics and near-zero computation power at memory side. Existing indexes supporting disaggregated memory either suffer from low write performance, or require hardware modification. We present Sherman, a write-optimized B(+)Tree index on disaggregated memory that delivers high performance with commodity RDMA NICs. Sherman combines RDMA hardware features and RDMA-friendly software techniques to boost index write performance from three angles. First, to reduce round trips, Sherman coalesces dependent RDMA commands by leveraging in-order delivery property of RDMA. Second, to accelerate concurrent accesses, Sherman introduces a hierarchical lock that exploits on-chip memory of RDMA NICs. Finally, to mitigate write amplification, Sherman tailors the data structure layout of B+ Tree with a two-level version mechanism. Our evaluation shows that, Sherman is one order of magnitude faster in terms of both throughput and 99th percentile latency on typical writeintensive workloads, compared with state-of-the-art designs.
引用
收藏
页码:45 / 52
页数:8
相关论文
共 50 条
  • [31] Write-Optimized and Consistent RDMA-based Non-Volatile Main Memory Systems
    Liu, Xinxin
    Hua, Yu
    Li, Xuan
    Liu, Qifan
    2021 IEEE 39TH INTERNATIONAL CONFERENCE ON COMPUTER DESIGN (ICCD 2021), 2021, : 248 - 251
  • [32] A read-efficient and write-optimized hash table for Intel Optane DC Persistent Memory
    Li, Zexuan
    Huang, Kaixin
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 161 : 49 - 65
  • [33] Watt: A Write-Optimized RRAM-Based Accelerator for Attention
    Zhang, Xuan
    Song, Zhuoran
    Li, Xing
    He, Zhezhi
    Jing, Naifeng
    Jiang, Li
    Liang, Xiaoyao
    EURO-PAR 2024: PARALLEL PROCESSING, PART II, EURO-PAR 2024, 2024, 14802 : 107 - 120
  • [34] RWORT: A Read and Write Optimized Radix Tree for Persistent Memory
    Hu, Jinlei
    Wei, Zijie
    Chen, Jianxi
    Feng, Dan
    2023 IEEE 41ST INTERNATIONAL CONFERENCE ON COMPUTER DESIGN, ICCD, 2023, : 194 - 197
  • [35] HDNH: a read-efficient and write-optimized hashing scheme for hybrid DRAM-NVM memory
    Zhu, Junhao
    Huang, Kaixin
    Zou, Xiaomin
    Huang, Chenglong
    Xu, Nuo
    Fang, Liang
    50TH INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING, 2021,
  • [36] Endurance Enhancement of Write-Optimized STT-RAM Caches
    Saraf, Puneet
    Mutyam, Madhu
    MEMSYS 2019: PROCEEDINGS OF THE INTERNATIONAL SYMPOSIUM ON MEMORY SYSTEMS, 2019, : 101 - 113
  • [37] Tracking Network Events with Write Optimized Data Structures The Design and Implementation of TWIAD: The Write-Optimized IP Address Database
    Donoghue, Nolan P.
    Hahn, Bridger
    Xu, Helen
    Kroeger, Thomas M.
    Zage, David
    Johnson, Rob
    2015 4TH INTERNATIONAL WORKSHOP ON BUILDING ANALYSIS DATASETS AND GATHERING EXPERIENCE RETURNS FOR SECURITY (BADGERS), 2015, : 1 - 7
  • [38] Brief Announcement: Root-to-Leaf Scheduling in Write-Optimized Trees
    Chung, Christopher
    Jannen, William
    McCauley, Samuel
    Simon, Bertrand
    PROCEEDINGS OF THE 36TH ACM SYMPOSIUM ON PARALLELISM IN ALGORITHMS AND ARCHITECTURES, SPAA 2024, 2024, : 475 - 477
  • [39] OurRocks: Offloading Disk Scan Directly to GPU in Write-Optimized Database System
    Choi, Won Gi
    Kim, Doyoung
    Roh, Hongchan
    Park, Sanghyun
    IEEE TRANSACTIONS ON COMPUTERS, 2021, 70 (11) : 1831 - 1844
  • [40] Marlin: A Concurrent andWrite-Optimized B plus -tree Index on Disaggregated Memory
    An, Hang
    Wang, Fang
    Feng, Dan
    Zou, Xiaomin
    Liu, Zefeng
    Zhang, Jianshun
    PROCEEDINGS OF THE 52ND INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING, ICPP 2023, 2023, : 695 - 704