Building Write-Optimized Tree Indexes on Disaggregated Memory

被引:42
|
作者
Wang, Qing [1 ]
Lu, Youyou [1 ]
Shu, Jiwu [1 ]
机构
[1] Tsinghua Univ, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
DISTRIBUTED TRANSACTIONS;
D O I
10.1145/3514221.3517824
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Memory disaggregation architecture physically separates CPU and memory into independent components, which are connected via high-speed RDMA networks, greatly improving resource utilization of database systems. However, such an architecture poses unique challenges to data indexing due to limited RDMA semantics and near-zero computation power at memory side. Existing indexes supporting disaggregated memory either suffer from low write performance, or require hardware modification. We present Sherman, a write-optimized B(+)Tree index on disaggregated memory that delivers high performance with commodity RDMA NICs. Sherman combines RDMA hardware features and RDMA-friendly software techniques to boost index write performance from three angles. First, to reduce round trips, Sherman coalesces dependent RDMA commands by leveraging in-order delivery property of RDMA. Second, to accelerate concurrent accesses, Sherman introduces a hierarchical lock that exploits on-chip memory of RDMA NICs. Finally, to mitigate write amplification, Sherman tailors the data structure layout of B+ Tree with a two-level version mechanism. Our evaluation shows that, Sherman is one order of magnitude faster in terms of both throughput and 99th percentile latency on typical writeintensive workloads, compared with state-of-the-art designs.
引用
收藏
页码:45 / 52
页数:8
相关论文
共 50 条
  • [41] A Memory-Disaggregated Radix Tree
    Luo, Xuchuan
    Zuo, Pengfei
    Shen, Jiacheng
    Gu, Jiazhen
    Wang, Xin
    Lyu, Michael
    Zhou, Yangfan
    ACM TRANSACTIONS ON STORAGE, 2024, 20 (03)
  • [42] Plush: A Write-Optimized Persistent Log-Structured Hash-Table
    Vogel, Lukas
    Van Renen, Alexander
    Imamura, Satoshi
    Giceva, Jana
    Neumann, Thomas
    Kemper, Alfons
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2022, 15 (11): : 2895 - 2907
  • [43] Optimizing LSM-based indexes for disaggregated memory
    Wang, Ruihong
    Gao, Chuqing
    Wang, Jianguo
    Kadam, Prishita
    Tamerozsu, M.
    Aref, Walid G.
    VLDB JOURNAL, 2024, 33 (06): : 1813 - 1836
  • [44] SifrDB: A Unified Solution for Write-Optimized Key-Value Stores in Large Datacenter
    Mei, Fei
    Cao, Qiang
    Jiang, Hong
    Li, Jingjun
    PROCEEDINGS OF THE 2018 ACM SYMPOSIUM ON CLOUD COMPUTING (SOCC '18), 2018, : 477 - 489
  • [45] Write-Optimized STT-MRAM Bit-Cells Using Asymmetrically Doped Transistors
    Choday, Sri Harsha
    Gupta, Sumeet K.
    Roy, Kaushik
    IEEE ELECTRON DEVICE LETTERS, 2014, 35 (11) : 1100 - 1102
  • [46] FastCache: A write-optimized edge storage system via concurrent merging cache for IoT applications
    Qian, Lin
    Qu, Zhihao
    Cai, Miao
    Ye, Baoliu
    Wang, Xiaoliang
    Wu, Jianyu
    Duan, Weiguo
    Zhao, Ming
    Lin, Qiang
    JOURNAL OF SYSTEMS ARCHITECTURE, 2022, 131
  • [47] LazyStore: Write-optimized Key-value Storage System Based on Hybrid Storage Architecture
    Du, Yun-Xiao
    Chen, Ke
    Shou, Li-Dan
    Jiang, Da-Wei
    Luo, Xin-Yuan
    Chen, Gang
    Ruan Jian Xue Bao/Journal of Software, 2025, 36 (02): : 805 - 829
  • [48] An Update-Overhead-Aware Caching Policy for Write-Optimized File Systems on SMR Disks
    Chen, Shuo-Han
    Li, Wei-Shin
    Shen, Min-Hong
    Lien, Yi-Han
    Chen, Tseng-Yi
    Hsu, Tsan-sheng
    Wei, Hsin-Wen
    Shih, Wei-Kuan
    2017 IEEE 36TH INTERNATIONAL PERFORMANCE COMPUTING AND COMMUNICATIONS CONFERENCE (IPCCC), 2017,
  • [49] ODLPIM: A Write-Optimized and Long-Lifetime ReRAM-Based Accelerator for Online Deep Learning
    Zhou, Heng
    Wu, Bing
    Cheng, Huan
    Zhao, Wei
    Wei, Xueliang
    Liu, Jinpeng
    Feng, Dan
    Tong, Wei
    2023 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION, DATE, 2023,
  • [50] SMART: A High-Performance Adaptive Radix Tree for Disaggregated Memory
    Luo, Xuchuan
    Zuo, Pengfei
    Shen, Jiacheng
    Gu, Jiazhen
    Wang, Xin
    Lyu, Michael R.
    Zhou, Yangfan
    PROCEEDINGS OF THE 17TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, OSDI 2023, 2023, : 553 - 571