High-availability in-memory key-value store using RDMA and Optane DCPMM

被引:0
|
作者
Xuecheng Qi
Huiqi Hu
Jinwei Guo
Chenchen Huang
Xuan Zhou
Ning Xu
Yu Fu
Aoying Zhou
机构
[1] East China Normal University,School of Data Science and Engineering
[2] China Construction Bank Financial Technology Co. Ltd.,undefined
来源
关键词
D O I
暂无
中图分类号
学科分类号
摘要
In this paper, we propose a fast high-availability in-memory key-value store based on RDMA network and Optane DCPMM named FaHA. FaHA proposes RDMA persist PRC that enables remote data persistence for fast log shipping with minimal round-trip and persistence overhead. FaHA further designs append-only storage with pipeline batching scheme in NVM and a hotness-aware differential hash index in DRAM to relieve read/write amplification of Optane DCPMM. Evaluations show that FaHA supports up to 2–3 synchronous backups without significantly lowering the primary’s performance, and outperforms existing works.
引用
收藏
相关论文
共 50 条
  • [31] Memory Efficient and High Performance Key-value Store on FPGA Using Cuckoo Hashing
    Liang, Wei
    Yin, Wenbo
    Kang, Ping
    Wang, Lingli
    [J]. 2016 26TH INTERNATIONAL CONFERENCE ON FIELD PROGRAMMABLE LOGIC AND APPLICATIONS (FPL), 2016,
  • [32] BiloKey : A Scalable Bi-Index Locality-Aware In-Memory Key-Value Store
    Ma, Wenlong
    Zhu, Yuqing
    Li, Cheng
    Guo, Mengying
    Bao, Yungang
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2019, 30 (07) : 1528 - 1540
  • [33] S3: A Scalable In-memory Skip-List Index for Key-Value Store
    Zhang, Jingtian
    Wu, Sai
    Tan, Zeyuan
    Chen, Gang
    Cheng, Zhushi
    Cao, Wei
    Gao, Yusong
    Feng, Xiaojie
    [J]. PROCEEDINGS OF THE VLDB ENDOWMENT, 2019, 12 (12): : 2183 - 2194
  • [34] HyperKV: A High Performance Concurrent Key-Value Store for Persistent Memory
    Sun, Penghao
    Xue, Dongliang
    You, Litong
    Yan, Yan
    Huang, Linpeng
    [J]. 19TH IEEE INTERNATIONAL SYMPOSIUM ON PARALLEL AND DISTRIBUTED PROCESSING WITH APPLICATIONS (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2021), 2021, : 125 - 134
  • [35] ShieldStore: Shielded In-memory Key-value Storage with SGX
    Kim, Taehoon
    Park, Joongun
    Woo, Jaewook
    Jeon, Seungheun
    Huh, Jaehyuk
    [J]. PROCEEDINGS OF THE FOURTEENTH EUROSYS CONFERENCE 2019 (EUROSYS '19), 2019,
  • [36] Efficient Software Rejuvenation of In-memory Key-Value Storages
    Jumonji, Yuto
    Yamada, Hiroshi
    [J]. 2017 IEEE 28TH INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING WORKSHOPS (ISSREW 2017), 2017, : 280 - 285
  • [37] XStore: Fast RDMA-Based Ordered Key-Value Store Using Remote Learned Cache
    Wei, Xingda
    Chen, Rong
    Chen, Haibo
    Zang, Binyu
    [J]. ACM TRANSACTIONS ON STORAGE, 2021, 17 (03)
  • [38] RHKV: An RDMA and HTM friendly key-value store for data-intensive computing
    Wu, Renke
    Huang, Linpeng
    Zhou, Haojie
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2019, 92 : 162 - 177
  • [39] SILT: A Memory-Efficient, High-Performance Key-Value Store
    Lim, Hyeontaek
    Fan, Bin
    Andersen, David G.
    Kaminsky, Michael
    [J]. SOSP 11: PROCEEDINGS OF THE TWENTY-THIRD ACM SYMPOSIUM ON OPERATING SYSTEMS PRINCIPLES, 2011, : 1 - 13
  • [40] XTENSTORE: Fast Shielded In-memory Key-Value Store on a Hybrid x86-FPGA System
    Oh, Hyunyoung
    Hwang, Dongil
    Malenko, Maja
    Cho, Myunghyun
    Moon, Hyungon
    Baunach, Marcel
    Paek, Yunheung
    [J]. PROCEEDINGS OF THE 2022 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE 2022), 2022, : 560 - 563