Building Write-Optimized Tree Indexes on Disaggregated Memory

被引:42
|
作者
Wang, Qing [1 ]
Lu, Youyou [1 ]
Shu, Jiwu [1 ]
机构
[1] Tsinghua Univ, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
DISTRIBUTED TRANSACTIONS;
D O I
10.1145/3514221.3517824
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Memory disaggregation architecture physically separates CPU and memory into independent components, which are connected via high-speed RDMA networks, greatly improving resource utilization of database systems. However, such an architecture poses unique challenges to data indexing due to limited RDMA semantics and near-zero computation power at memory side. Existing indexes supporting disaggregated memory either suffer from low write performance, or require hardware modification. We present Sherman, a write-optimized B(+)Tree index on disaggregated memory that delivers high performance with commodity RDMA NICs. Sherman combines RDMA hardware features and RDMA-friendly software techniques to boost index write performance from three angles. First, to reduce round trips, Sherman coalesces dependent RDMA commands by leveraging in-order delivery property of RDMA. Second, to accelerate concurrent accesses, Sherman introduces a hierarchical lock that exploits on-chip memory of RDMA NICs. Finally, to mitigate write amplification, Sherman tailors the data structure layout of B+ Tree with a two-level version mechanism. Our evaluation shows that, Sherman is one order of magnitude faster in terms of both throughput and 99th percentile latency on typical writeintensive workloads, compared with state-of-the-art designs.
引用
收藏
页码:45 / 52
页数:8
相关论文
共 50 条
  • [21] AB-Tree: A Write-optimized Adaptive Index Structure on Solid State Disk
    Jiang, Zhiwen
    Wu, Yongji
    Zhang, Yong
    Li, Chao
    Xing, Chunxiao
    2014 11TH WEB INFORMATION SYSTEM AND APPLICATION CONFERENCE (WISA), 2014, : 188 - 193
  • [22] Write-Optimized and High-Performance Hashing Index Scheme for Persistent Memory
    Zuo, Pengfei
    Hua, Yu
    Wu, Jie
    PROCEEDINGS OF THE 13TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, 2018, : 461 - 476
  • [23] A Write-Optimized Re-computation Scheme for Non-Volatile Memory
    Zhang M.
    Hua Y.
    Liu L.
    Hu R.
    Li Z.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2020, 57 (02): : 243 - 256
  • [24] ReoFS: A Read-Efficient and Write-Optimized File System for Persistent Memory
    Yan, Yan
    Huang, Kaixin
    Zheng, Shengan
    Xue, Dongliang
    Huang, Linpeng
    2020 25TH INTERNATIONAL CONFERENCE ON ENGINEERING OF COMPLEX COMPUTER SYSTEMS (ICECCS 2020), 2020, : 177 - 186
  • [25] FlatLSM: Write-Optimized LSM-Tree for PM-Based KV Stores
    He, Kewen
    An, Yujie
    Luo, Yijing
    Liu, Xiaoguang
    Wang, Gang
    ACM TRANSACTIONS ON STORAGE, 2023, 19 (02)
  • [26] Zallocator: A High Throughput Write-Optimized Persistent Allocator for Non-Volatile Memory
    Wu, You
    Li, Lin
    ACM JOURNAL ON EMERGING TECHNOLOGIES IN COMPUTING SYSTEMS, 2022, 18 (04)
  • [27] Mitigating the Write Amplification Problem of Write-Optimized File Systems on Flash Storage
    Chen, Shuo-Han
    Lin, Jun-Long
    Chen, Tseng-Yi
    Wei, Hsin-Wen
    Hsu, Tsan-Sheng
    Shih, Wei-Kuan
    2017 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING (CLUSTER), 2017, : 615 - 616
  • [28] WOKV: A Write-Optimized Key-Value Store
    Zhan, Ling
    Yu, Kan
    Zhou, Chenxi
    Tang, Chenlei
    2018 IEEE 3RD INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA ANALYSIS (ICCCBDA), 2018, : 527 - 531
  • [29] Write-Optimized Indexing with Partitioned B-Trees
    Riegger, Christian
    Vincon, Tobias
    Petrov, Ilia
    19TH INTERNATIONAL CONFERENCE ON INFORMATION INTEGRATION AND WEB-BASED APPLICATIONS & SERVICES (IIWAS2017), 2017, : 296 - 300
  • [30] Optimizing Every Operation in a Write-Optimized File System
    Yuan, Jun
    Zhan, Yang
    Jannen, William
    Pandey, Prashant
    Akshintala, Amogh
    Chandnani, Kanchan
    Deo, Pooja
    Kasheff, Zardosht
    Walsh, Leif
    Bender, Michael A.
    Farach-Colton, Martin
    Johnson, Rob
    Kuszmaul, Bradley C.
    Porter, Donald E.
    14TH USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES (FAST '16), 2016, : 1 - 14