Fast In-memory Transaction Processing using RDMA and HTM

被引:178
|
作者
Wei, Xingda [1 ]
Shi, Jiaxin [1 ]
Chen, Yanzhe [1 ]
Chen, Rong [1 ]
Chen, Haibo [1 ]
机构
[1] Shanghai Jiao Tong Univ, Shanghai Key Lab Scalable Comp & Syst, Inst Parallel & Distributed Syst, Shanghai, Peoples R China
基金
国家教育部博士点专项基金资助;
关键词
D O I
10.1145/2815400.2815419
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We present DrTM, a fast in-memory transaction processing system that exploits advanced hardware features (i.e., RDMA and HTM) to improve latency and throughput by over one order of magnitude compared to state-of-the-art distributed transaction systems. The high performance of DrTM are enabled by mostly offloading concurrency control within a local machine into HTM and leveraging the strong consistency between RDMA and HTM to ensure serializability among concurrent transactions across machines. We further build an efficient hash table for DrTM by leveraging HTM and RDMA to simplify the design and notably improve the performance. We describe how DrTM supports common database features like read-only transactions and logging for durability. Evaluation using typical OLTP workloads including TPC-C and SmallBank show that DrTM scales well on a 6-node cluster and achieves over 5.52 and 138 million transactions per second for TPC-C and SmallBank respectively. This number outperforms a state-of-the-art distributed transaction system (namely Calvin) by at least 17.9X for TPC-C.
引用
收藏
页码:87 / 104
页数:18
相关论文
共 50 条
  • [1] Fast In-Memory Transaction Processing Using RDMA and HTM
    Chen, Haibo
    Chen, Rong
    Wei, Xingda
    Shi, Jiaxin
    Chen, Yanzhe
    Wang, Zhaoguo
    Zang, Binyu
    Guan, Haibing
    [J]. ACM TRANSACTIONS ON COMPUTER SYSTEMS, 2017, 35 (01):
  • [2] Scalable In-Memory Transaction Processing with HTM
    Wu, Yingjun
    Tan, Kian-Lee
    [J]. PROCEEDINGS OF USENIX ATC '16: 2016 USENIX ANNUAL TECHNICAL CONFERENCE, 2016, : 365 - 377
  • [3] Rack-Scale In-Memory Join Processing using RDMA
    Barthels, Claude
    Loesing, Simon
    Alonso, Gustavo
    Kossmann, Donald
    [J]. SIGMOD'15: PROCEEDINGS OF THE 2015 ACM SIGMOD INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2015, : 1463 - 1475
  • [4] Blitzcrank: Fast Semantic Compression for In-memory Online Transaction Processing
    Qiao, Yiming
    Gao, Yihan
    Zhang, Huanchen
    [J]. PROCEEDINGS OF THE VLDB ENDOWMENT, 2024, 17 (10): : 2528 - 2540
  • [5] Fast and General Distributed Transactions using RDMA and HTM
    Chen, Yanzhe
    Wei, Xingda
    Shi, Jiaxin
    Chen, Rong
    Chen, Haibo
    [J]. PROCEEDINGS OF THE ELEVENTH EUROPEAN CONFERENCE ON COMPUTER SYSTEMS, (EUROSYS 2016), 2016,
  • [6] Fast In-Memory Key-Value Cache System with RDMA
    Ghen, Wei
    Yu, Songping
    Wang, Zhiying
    [J]. JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2019, 28 (05)
  • [7] Accelerating in-memory transaction processing using general purpose graphics processing units
    Gao, Lan
    Xu, Yunlong
    Wang, Rui
    Yang, Hailong
    Luan, Zhongzhi
    Qian, Depei
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2019, 97 : 836 - 848
  • [8] In-memory transaction processing: efficiency and scalability considerations
    Hu, Huiqi
    Zhou, Xuan
    Zhu, Tao
    Qian, Weining
    Zhou, Aoying
    [J]. KNOWLEDGE AND INFORMATION SYSTEMS, 2019, 61 (03) : 1209 - 1240
  • [9] In-memory transaction processing: efficiency and scalability considerations
    Huiqi Hu
    Xuan Zhou
    Tao Zhu
    Weining Qian
    Aoying Zhou
    [J]. Knowledge and Information Systems, 2019, 61 : 1209 - 1240
  • [10] Interactive Transaction Processing for In-Memory Database System
    Zhu, Tao
    Wang, Donghui
    Hu, Huiqi
    Qian, Weining
    Wang, Xiaoling
    Zhou, Aoying
    [J]. DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2018), PT II, 2018, 10828 : 228 - 246