RS-store: A SkipList-Based Key-Value Store with Remote Direct Memory Access

被引:2
|
作者
Huang, Chenchen [1 ]
Hu, Huiqi [1 ]
Qi, Xuecheng [1 ]
Zhou, Xuan [1 ]
Zhou, Aoying [1 ]
机构
[1] East China Normal Univ, Sch Data Sci & Engn, Shanghai, Peoples R China
基金
美国国家科学基金会; 国家重点研发计划;
关键词
Skiplist; Key-value store; RDMA;
D O I
10.1007/978-3-030-59410-7_22
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Many key-value stores use RDMA to optimize the messaging and data transmission between application layer and storage layer, most of which only provide point-wise operations. Skiplist-based store can support both point operations and range queries, but its CPU-intensive access operations combined with the high-speed network will easily lead to the storage layer reaches CPU bottlenecks. In this paper, we present RS-store, a skiplist-based key-value store with RDMA, which can overcome the cpu handle of the storage layer by enabling two access modes: local access and remote access. In RS-store, we redesign a novel data structure R-skiplist to save the communication cost in remote access, and implement a latch-free concurrency control mechanism to ensure all the concurrency during two access modes. At last, our evaluation on a RDMA-capable cluster shows that the performance of RS-store over R-skiplist is 0.6 x(-1) x higher than the existing skiplist, and it supports application layer's high scalability.
引用
下载
收藏
页码:314 / 323
页数:10
相关论文
共 50 条
  • [1] RS-store: RDMA-enabled skiplist-based key-value store for efficient range query
    Chenchen HUANG
    Huiqi HU
    Xuecheng Qi
    Xuan ZHOU
    Aoying ZHOU
    Frontiers of Computer Science, 2021, (06) : 105 - 118
  • [2] RS-store: RDMA-enabled skiplist-based key-value store for efficient range query
    Huang, Chenchen
    Hu, Huiqi
    Qi, Xuecheng
    Zhou, Xuan
    Zhou, Aoying
    FRONTIERS OF COMPUTER SCIENCE, 2021, 15 (06)
  • [3] RS-store: RDMA-enabled skiplist-based key-value store for efficient range query
    Chenchen Huang
    Huiqi Hu
    Xuecheng Qi
    Xuan Zhou
    Aoying Zhou
    Frontiers of Computer Science, 2021, 15
  • [4] Design and implementation of skiplist-based key-value store on non-volatile memory
    Qichen Chen
    Hyojeong Lee
    Yoonhee Kim
    Heon Young Yeom
    Yongseok Son
    Cluster Computing, 2019, 22 : 361 - 371
  • [5] Design and implementation of skiplist-based key-value store on non-volatile memory
    Chen, Qichen
    Lee, Hyojeong
    Kim, Yoonhee
    Yeom, Heon Young
    Son, Yongseok
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2019, 22 (02): : 361 - 371
  • [6] Design of skiplist based key-value store on non-volatile memroy
    Chen, Qichen
    Yeom, Heonyoung
    2018 IEEE 3RD INTERNATIONAL WORKSHOPS ON FOUNDATIONS AND APPLICATIONS OF SELF* SYSTEMS (FAS*W), 2018, : 44 - 50
  • [7] LibreKV: A Persistent in-Memory Key-Value Store
    Liu, Hao
    Huang, Linpeng
    Zhu, Yanmin
    Shen, Yanyan
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2020, 8 (04) : 916 - 927
  • [8] ChameleonDB: a Key-value Store for Optane Persistent Memory
    Zhang, Wenhui
    Zhao, Xingsheng
    Jiang, Song
    Jiang, Hong
    PROCEEDINGS OF THE SIXTEENTH EUROPEAN CONFERENCE ON COMPUTER SYSTEMS (EUROSYS '21), 2021, : 194 - 209
  • [9] KVLight: A Lightweight Key-Value Store for Distributed Access in Cloud
    Zeng, Jiaan
    Plale, Beth
    2016 16TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING (CCGRID), 2016, : 473 - 482
  • [10] In-Memory Key-Value Store Live Migration with NetMigrate
    Zhu, Zeying
    Zhao, Yibo
    Liu, Zaoxing
    PROCEEDINGS OF THE 21ST USENIX SYMPOSIUM ON NETWORKED SYSTEMS DESIGN AND IMPLEMENTATION, NSDI 24, 2024, : 209 - 224