Replicated Layout for In-Memory Database Systems

被引:4
|
作者
Sudhir, Sivaprasad [1 ]
Cafarella, Michael [1 ]
Madden, Samuel [1 ]
机构
[1] MIT, Cambridge, MA 02139 USA
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2021年 / 15卷 / 04期
基金
美国国家科学基金会;
关键词
FILE;
D O I
10.14778/3503585.3503606
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Scanning and filtering are the foundations of analytical database systems. Modern DBMSs employ a variety of techniques to partition and layout data to improve the performance of these operations. To accelerate query performance, systems tune data layout to reduce the cost of accessing and processing data. However, these layouts optimize for the average query, and with heterogeneous data access patterns in parts of the data, their performance degrades. To mitigate this, we present CopyRight, a layout-aware partial replication engine that replicates parts of the data differently and lays out each replica differently to maximize the overall query performance. Across a range of real-world query workloads, CopyRight is able to achieve 1.1X to 7.9X faster performance than the best non-replicated layout with 0.25X space overhead. When compared to full table replication with 100% overhead, CopyRight attains the same or up to 5.2X speedup with 25% space overhead.
引用
收藏
页码:984 / 997
页数:14
相关论文
共 50 条
  • [21] Robust and Budget-Constrained Encoding Configurations for In-Memory Database Systems
    Boissier, Martin
    [J]. PROCEEDINGS OF THE VLDB ENDOWMENT, 2021, 15 (04): : 780 - 793
  • [22] Parallelizing Skip Lists for In-memory Multi-core Database Systems
    Xie, Zhongle
    Cai, Qingchao
    Jagadish, H. V.
    Ooi, Beng Chin
    Wong, Weng-Fai
    [J]. 2017 IEEE 33RD INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2017), 2017, : 119 - 122
  • [23] In-memory database acceleration on FPGAs: a survey
    Jian Fang
    Yvo T. B. Mulder
    Jan Hidders
    Jinho Lee
    H. Peter Hofstee
    [J]. The VLDB Journal, 2020, 29 : 33 - 59
  • [24] Elastic Pipelining in an In-Memory Database Cluster
    Wang, Li
    Zhou, Minqi
    Zhang, Zhenjie
    Yang, Yin
    Zhou, Aoying
    Bitton, Dina
    [J]. SIGMOD'16: PROCEEDINGS OF THE 2016 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2016, : 1279 - 1294
  • [25] Distributed Architecture of Oracle Database In-memory
    Mukherjee, Niloy
    Chavan, Shasank
    Colgan, Maria
    Das, Dinesh
    Gleeson, Mike
    Hase, Sanket
    Holloway, Allison
    Jin, Hui
    Kamp, Jesse
    Kulkarni, Kartik
    Lahiri, Tirthankar
    Loaiza, Juan
    Macnaughton, Neil
    Marwah, Vineet
    Mullick, Atrayee
    Witkowski, Andy
    Yan, Jiaqi
    Zait, Mohamed
    [J]. PROCEEDINGS OF THE VLDB ENDOWMENT, 2015, 8 (12): : 1630 - 1641
  • [26] ScaleDB: A Scalable, Asynchronous In-Memory Database
    Mehdi, Syed Akbar
    Hwang, Deukyeon
    Peter, Simon
    Alvisi, Lorenzo
    [J]. PROCEEDINGS OF THE 17TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, OSDI 2023, 2023, : 361 - 376
  • [27] In-memory database acceleration on FPGAs: a survey
    Fang, Jian
    Mulder, Yvo T. B.
    Hidders, Jan
    Lee, Jinho
    Hofstee, H. Peter
    [J]. VLDB JOURNAL, 2020, 29 (01): : 33 - 59
  • [28] imGraph: A distributed in-memory graph database
    Jouili, Salim
    Reynaga, Aldemar
    [J]. 2013 ASE/IEEE INTERNATIONAL CONFERENCE ON SOCIAL COMPUTING (SOCIALCOM), 2013, : 732 - 737
  • [29] Using Storage Class Memory Efficiently for an In-memory Database
    Gottesman, Yonatan
    Nider, Joel
    Kat, Ronen
    Weinsberg, Yaron
    Factor, Michael
    [J]. PROCEEDINGS OF THE 9TH ACM INTERNATIONAL SYSTEMS AND STORAGE CONFERENCE (SYSTOR'16), 2016,
  • [30] Looking into the Peak Memory Consumption of Epoch-Based Reclamation in Scalable in-Memory Database Systems
    Mitake, Hitoshi
    Yamada, Hiroshi
    Nakajima, Tatsuo
    [J]. DATABASE AND EXPERT SYSTEMS APPLICATIONS, PT II, 2019, 11707 : 3 - 18