Incremental Materialized View Maintenance on Distributed Log-Structured Merge-Tree

被引:3
|
作者
Duan, Huichao [1 ]
Hu, Huiqi [1 ]
Qian, Weining [1 ]
Ma, Haixin [1 ]
Wang, Xiaoling [1 ]
Zhou, Aoying [1 ]
机构
[1] East China Normal Univ, Shanghai, Peoples R China
基金
美国国家科学基金会;
关键词
D O I
10.1007/978-3-319-91458-9_42
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Modern database systems are in need of supporting highly scalable transactions of data updates and efficient queries over data simultaneously for the real-time applications. One solution to reach the demand is to implement query optimization techniques on the online transaction processing (OLTP) systems. The materialized view is considered as a panacea to improve query latency. However, it also involves a significant cost of maintenance which trades away transaction performance. In this paper, we develop materialized views on a distributed log-structured merge-tree (LSM-tree), which is a well-known structure adopted to improve data write performance. We examine the design space and conclude several design features for the implementation of view on LSM-tree. An asynchronous approach with two optimizations are proposed to decouple the view maintenance with transaction process. Under the asynchronous update, we also provide consistency query for views. Experiments on TPC-H benchmark show our method achieves better performance than straightforward methods on different workloads.
引用
收藏
页码:682 / 700
页数:19
相关论文
共 47 条
  • [1] Precise Data Access on Distributed Log-Structured Merge-Tree
    Zhu, Tao
    Hu, Huiqi
    Qian, Weining
    Zhou, Aoying
    Liu, Mengzhan
    Zhao, Qiong
    WEB AND BIG DATA, APWEB-WAIM 2017, PT II, 2017, 10367 : 210 - 218
  • [2] The log-structured merge-tree (LSM-tree)
    ONeil, P
    Cheng, E
    Gawlick, D
    ONeil, E
    ACTA INFORMATICA, 1996, 33 (04) : 351 - 385
  • [3] Partition pruning for range query on distributed log-structured merge-tree
    Huang, Chenchen
    Hu, Huiqi
    Wei, Xing
    Qian, Weining
    Zhou, Aoying
    FRONTIERS OF COMPUTER SCIENCE, 2020, 14 (03)
  • [4] Partition pruning for range query on distributed log-structured merge-tree
    Chenchen Huang
    Huiqi Hu
    Xing Wei
    Weining Qian
    Aoying Zhou
    Frontiers of Computer Science, 2020, 14
  • [5] Fault-tolerant precise data access on distributed log-structured merge-tree
    Zhu, Tao
    Hu, Huiqi
    Qian, Weining
    Zhou, Huan
    Zhou, Aoying
    FRONTIERS OF COMPUTER SCIENCE, 2019, 13 (04) : 760 - 777
  • [6] Fault-tolerant precise data access on distributed log-structured merge-tree
    Tao Zhu
    Huiqi Hu
    Weining Qian
    Huan Zhou
    Aoying Zhou
    Frontiers of Computer Science, 2019, 13 : 760 - 777
  • [7] Incremental join view maintenance on distributed log-structured storage
    Huichao Duan
    Huiqi Hu
    Weining Qian
    Aoying Zhou
    Frontiers of Computer Science, 2021, 15
  • [8] Incremental join view maintenance on distributed log-structured storage
    Huichao DUAN
    Huiqi HU
    Weining QIAN
    Aoying ZHOU
    Frontiers of Computer Science, 2021, (04) : 110 - 125
  • [9] Incremental join view maintenance on distributed log-structured storage
    Duan, Huichao
    Hu, Huiqi
    Qian, Weining
    Zhou, Aoying
    FRONTIERS OF COMPUTER SCIENCE, 2021, 15 (04)
  • [10] TLSM: Tiered Log-Structured Merge-Tree Utilizing Non-Volatile Memory
    Lee, Jihwan
    Choi, Won Gi
    Kim, Doyoung
    Sung, Hanseung
    Park, Sanghyun
    IEEE ACCESS, 2020, 8 : 100948 - 100962