High-availability in-memory key-value store using RDMA and Optane DCPMM

被引:0
|
作者
Xuecheng Qi
Huiqi Hu
Jinwei Guo
Chenchen Huang
Xuan Zhou
Ning Xu
Yu Fu
Aoying Zhou
机构
[1] East China Normal University,School of Data Science and Engineering
[2] China Construction Bank Financial Technology Co. Ltd.,undefined
来源
关键词
D O I
暂无
中图分类号
学科分类号
摘要
In this paper, we propose a fast high-availability in-memory key-value store based on RDMA network and Optane DCPMM named FaHA. FaHA proposes RDMA persist PRC that enables remote data persistence for fast log shipping with minimal round-trip and persistence overhead. FaHA further designs append-only storage with pipeline batching scheme in NVM and a hotness-aware differential hash index in DRAM to relieve read/write amplification of Optane DCPMM. Evaluations show that FaHA supports up to 2–3 synchronous backups without significantly lowering the primary’s performance, and outperforms existing works.
引用
收藏
相关论文
共 50 条
  • [1] High-availability in-memory key-value store using RDMA and Optane DCPMM
    Qi, Xuecheng
    Hu, Huiqi
    Guo, Jinwei
    Huang, Chenchen
    Zhou, Xuan
    Xu, Ning
    Fu, Yu
    Zhou, Aoying
    [J]. FRONTIERS OF COMPUTER SCIENCE, 2023, 17 (01)
  • [2] ChameleonDB: a Key-value Store for Optane Persistent Memory
    Zhang, Wenhui
    Zhao, Xingsheng
    Jiang, Song
    Jiang, Hong
    [J]. PROCEEDINGS OF THE SIXTEENTH EUROPEAN CONFERENCE ON COMPUTER SYSTEMS (EUROSYS '21), 2021, : 194 - 209
  • [3] Fast In-Memory Key-Value Cache System with RDMA
    Ghen, Wei
    Yu, Songping
    Wang, Zhiying
    [J]. JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2019, 28 (05)
  • [4] LibreKV: A Persistent in-Memory Key-Value Store
    Liu, Hao
    Huang, Linpeng
    Zhu, Yanmin
    Shen, Yanyan
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2020, 8 (04) : 916 - 927
  • [5] In-Memory Key-Value Store Live Migration with NetMigrate
    Zhu, Zeying
    Zhao, Yibo
    Liu, Zaoxing
    [J]. PROCEEDINGS OF THE 21ST USENIX SYMPOSIUM ON NETWORKED SYSTEMS DESIGN AND IMPLEMENTATION, NSDI 24, 2024, : 209 - 224
  • [6] In-Memory Key-Value Store Live Migration with NetMigrate
    Zhu, Zeying
    Zhao, Yibo
    Liu, Zaoxing
    [J]. PROCEEDINGS OF THE 22ND USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES, FAST 24, 2024, : 209 - 224
  • [7] SKVM: Scaling In-Memory Key-Value Store on Multicore
    Zheng, Ran
    Wang, Wenjin
    Jin, Hai
    Zhang, Qin
    [J]. 2015 IEEE SYMPOSIUM ON COMPUTERS AND COMMUNICATION (ISCC), 2015, : 601 - 606
  • [8] Rethinking Key-Value Store for Byte-Addressable Optane Persistent Memory
    Wu, Sung-Ming
    Chang, Li-Pin
    [J]. PROCEEDINGS OF THE 59TH ACM/IEEE DESIGN AUTOMATION CONFERENCE, DAC 2022, 2022, : 805 - 810
  • [9] HotRing: A Hotspot-Aware In-Memory Key-Value Store
    Chen, Jiqiang
    Chen, Liang
    Wang, Sheng
    Zhu, Guoyun
    Sun, Yuanyuan
    Liu, Huan
    Li, Feifei
    [J]. PROCEEDINGS OF THE 18TH USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES, 2020, : 239 - 252
  • [10] SwapKV: A Hotness Aware In-Memory Key-Value Store for Hybrid Memory Systems
    Cui, Lixiao
    He, Kewen
    Li, Yusen
    Li, Peng
    Zhang, Jiachen
    Wang, Gang
    Liu, Xiaoguang
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (01) : 917 - 930