Incremental Materialized View Maintenance on Distributed Log-Structured Merge-Tree

被引:3
|
作者
Duan, Huichao [1 ]
Hu, Huiqi [1 ]
Qian, Weining [1 ]
Ma, Haixin [1 ]
Wang, Xiaoling [1 ]
Zhou, Aoying [1 ]
机构
[1] East China Normal Univ, Shanghai, Peoples R China
基金
美国国家科学基金会;
关键词
D O I
10.1007/978-3-319-91458-9_42
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Modern database systems are in need of supporting highly scalable transactions of data updates and efficient queries over data simultaneously for the real-time applications. One solution to reach the demand is to implement query optimization techniques on the online transaction processing (OLTP) systems. The materialized view is considered as a panacea to improve query latency. However, it also involves a significant cost of maintenance which trades away transaction performance. In this paper, we develop materialized views on a distributed log-structured merge-tree (LSM-tree), which is a well-known structure adopted to improve data write performance. We examine the design space and conclude several design features for the implementation of view on LSM-tree. An asynchronous approach with two optimizations are proposed to decouple the view maintenance with transaction process. Under the asynchronous update, we also provide consistency query for views. Experiments on TPC-H benchmark show our method achieves better performance than straightforward methods on different workloads.
引用
收藏
页码:682 / 700
页数:19
相关论文
共 47 条
  • [41] SILK plus Preventing Latency Spikes in Log-Structured Merge Key-Value Stores Running Heterogeneous Workloads
    Balmau, Oana
    Dinu, Florin
    Zwaenepoel, Willy
    Gupta, Karan
    Chandhiramoorthi, Ravishankar
    Didona, Diego
    ACM TRANSACTIONS ON COMPUTER SYSTEMS, 2020, 36 (04):
  • [42] SLSM - A Scalable Log Structured Merge Tree with Bloom Filters for Low Latency Analytics
    Riyaz, P. A.
    Varghese, Surekha Mariam
    INTERNATIONAL CONFERENCE ON EMERGING TRENDS IN ENGINEERING, SCIENCE AND TECHNOLOGY (ICETEST - 2015), 2016, 24 : 1491 - 1498
  • [43] Incremental View Maintenance By Base Relation Tagging in Distributed Databases
    James Bailey
    Guozhu Dong
    Mukesh Mohania
    X. Sean Wang
    Distributed and Parallel Databases, 1998, 6 : 287 - 309
  • [44] Incremental view maintenance by base relation tagging in distributed databases
    Bailey, J
    Dong, GZ
    Mohania, M
    Wang, XS
    DISTRIBUTED AND PARALLEL DATABASES, 1998, 6 (03) : 287 - 309
  • [45] The LSM RUM-Tree: A Log Structured Merge R-Tree for Update-intensive Spatial Workloads
    Shin, Jaewoo
    Wang, Jianguo
    Aref, Walid G.
    2021 IEEE 37TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2021), 2021, : 2285 - 2290
  • [46] Vigil-KV: Hardware-Software Co-Design to Integrate Strong Latency Determinism into Log-Structured Merge Key-Value Stores
    Kwon, Miryeong
    Lee, Seungjun
    Choi, Hyunkyu
    Hwang, Jooyoung
    Jung, Myoungsoo
    PROCEEDINGS OF THE 2022 USENIX ANNUAL TECHNICAL CONFERENCE, 2022, : 755 - 771
  • [47] How to Win a Hot Dog Eating Contest: Distributed Incremental View Maintenance with Batch Updates
    Nikolic, Milos
    Dashti, Mohammad
    Koch, Christoph
    SIGMOD'16: PROCEEDINGS OF THE 2016 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2016, : 511 - 526