Replicated Layout for In-Memory Database Systems

被引:4
|
作者
Sudhir, Sivaprasad [1 ]
Cafarella, Michael [1 ]
Madden, Samuel [1 ]
机构
[1] MIT, Cambridge, MA 02139 USA
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2021年 / 15卷 / 04期
基金
美国国家科学基金会;
关键词
FILE;
D O I
10.14778/3503585.3503606
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Scanning and filtering are the foundations of analytical database systems. Modern DBMSs employ a variety of techniques to partition and layout data to improve the performance of these operations. To accelerate query performance, systems tune data layout to reduce the cost of accessing and processing data. However, these layouts optimize for the average query, and with heterogeneous data access patterns in parts of the data, their performance degrades. To mitigate this, we present CopyRight, a layout-aware partial replication engine that replicates parts of the data differently and lays out each replica differently to maximize the overall query performance. Across a range of real-world query workloads, CopyRight is able to achieve 1.1X to 7.9X faster performance than the best non-replicated layout with 0.25X space overhead. When compared to full table replication with 100% overhead, CopyRight attains the same or up to 5.2X speedup with 25% space overhead.
引用
收藏
页码:984 / 997
页数:14
相关论文
共 50 条
  • [1] Demonstration of Chestnut: An In-memory Data Layout Designer for Database Applications
    Samuel, Mingwei
    Yan, Cong
    Cheung, Alvin
    [J]. SIGMOD'20: PROCEEDINGS OF THE 2020 ACM SIGMOD INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2020, : 2813 - 2816
  • [2] Oracle Database In-Memory: A Dual Format In-Memory Database
    Lahiri, Tirthankar
    Chavan, Shasank
    Colgan, Maria
    Das, Dinesh
    Ganesh, Amit
    Gleeson, Mike
    Hase, Sanket
    Holloway, Allison
    Kamp, Jesse
    Lee, Teck-Hua
    Loaiza, Juan
    Macnaughton, Neil
    Marwah, Vineet
    Mukherjee, Niloy
    Mullick, Atrayee
    Muthulingam, Sujatha
    Raja, Vivekanandhan
    Roth, Marty
    Soylemez, Ekrem
    Zait, Mohamed
    [J]. 2015 IEEE 31ST INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE), 2015, : 1253 - 1258
  • [3] A prefetching indexing scheme for in-memory database systems
    Zhang, Qian
    Song, Haoyun
    Zhou, Kaiyan
    Wei, Jianhao
    Xiao, Chuqiao
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 156 : 179 - 190
  • [4] Enabling CXL Memory Expansion for In-Memory Database Management Systems
    Ahn, Minseon
    Lee, Donghun
    Kim, Jungmin
    Rebholz, Oliver
    Chang, Andrew
    Gim, Jongmin
    Jung, Jaemin
    Pham, Vincent
    Malladi, Krishna T.
    Ki, Yang Seok
    [J]. 18TH INTERNATIONAL WORKSHOP ON DATA MANAGEMENT ON NEW HARDWARE, DAMON 2022, 2022,
  • [5] Elastic Use of Far Memory for In-Memory Database Management Systems
    Lee, Donghun
    Ahn, Minseon
    Kim, Jungmin
    Booss, Daniel
    Ritter, Daniel
    Rebholz, Oliver
    Willhalm, Thomas
    Desai, Suprasad Mutalik
    Singh, Navneet
    [J]. 19TH INTERNATIONAL WORKSHOP ON DATA MANAGEMENT ON NEW HARDWARE, DAMON 2023, 2023, : 35 - 43
  • [6] Benchmarking in-memory database
    Cheqing Jin
    Yangxin Kong
    Qiangqiang Kang
    Weining Qian
    Aoying Zhou
    [J]. Frontiers of Computer Science, 2016, 10 : 1067 - 1081
  • [7] Benchmarking in-memory database
    Cheqing JIN
    Yangxin KONG
    Qiangqiang KANG
    Weining QIAN
    Aoying ZHOU
    [J]. Frontiers of Computer Science., 2016, 10 (06) - 1081
  • [8] In-Memory Database Query
    Giannopoulos, Iason
    Singh, Abhairaj
    Le Gallo, Manuel
    Jonnalagadda, Vara Prasad
    Hamdioui, Said
    Sebastian, Abu
    [J]. ADVANCED INTELLIGENT SYSTEMS, 2020, 2 (12)
  • [9] Benchmarking in-memory database
    Jin, Cheqing
    Kong, Yangxin
    Kang, Qiangqiang
    Qian, Weining
    Zhou, Aoying
    [J]. FRONTIERS OF COMPUTER SCIENCE, 2016, 10 (06) : 1067 - 1081
  • [10] Index Checkpoints for Instant Recovery in In-Memory Database Systems
    Lee, Leon
    Xie, Siphrey
    Ma, Yunus
    Chen, Shimin
    [J]. PROCEEDINGS OF THE VLDB ENDOWMENT, 2022, 15 (08): : 1671 - 1683