Incremental Materialized View Maintenance on Distributed Log-Structured Merge-Tree

被引:3
|
作者
Duan, Huichao [1 ]
Hu, Huiqi [1 ]
Qian, Weining [1 ]
Ma, Haixin [1 ]
Wang, Xiaoling [1 ]
Zhou, Aoying [1 ]
机构
[1] East China Normal Univ, Shanghai, Peoples R China
来源
DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2018), PT II | 2018年 / 10828卷
基金
美国国家科学基金会;
关键词
D O I
10.1007/978-3-319-91458-9_42
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Modern database systems are in need of supporting highly scalable transactions of data updates and efficient queries over data simultaneously for the real-time applications. One solution to reach the demand is to implement query optimization techniques on the online transaction processing (OLTP) systems. The materialized view is considered as a panacea to improve query latency. However, it also involves a significant cost of maintenance which trades away transaction performance. In this paper, we develop materialized views on a distributed log-structured merge-tree (LSM-tree), which is a well-known structure adopted to improve data write performance. We examine the design space and conclude several design features for the implementation of view on LSM-tree. An asynchronous approach with two optimizations are proposed to decouple the view maintenance with transaction process. Under the asynchronous update, we also provide consistency query for views. Experiments on TPC-H benchmark show our method achieves better performance than straightforward methods on different workloads.
引用
收藏
页码:682 / 700
页数:19
相关论文
共 47 条
  • [21] A Log-Structured Merge Tree-aware Message Authentication Scheme for Persistent Key-Value Stores
    Kim, Igjae
    Kim, J. Hyun
    Chung, Minu
    Moon, Hyungon
    Noh, Sam H.
    PROCEEDINGS OF THE 20TH USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES, FAST 2022, 2022, : 363 - 379
  • [22] Efficient key-value stores with Ranged Log-structured Merge Trees
    Song, Nae Young
    Yeom, Heon Young
    Han, Hyuck
    PROCEEDINGS 2018 IEEE 11TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD), 2018, : 652 - 659
  • [23] Optimizing Optimistic Concurrency Control for Tree-Structured, Log-Structured Databases
    Bernstein, Philip A.
    Das, Sudipto
    Ding, Bailu
    Pilman, Markus
    SIGMOD'15: PROCEEDINGS OF THE 2015 ACM SIGMOD INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2015, : 1295 - 1309
  • [24] HIndex-FLSM: Fragmented Log-Structured Merge Trees Integrated with Heat and Index
    Wang, Xiaopeng
    Li, Hui
    Tan, Hong
    Wang, Xiyu
    Lu, Ping
    Wang, Han
    2024 3RD INTERNATIONAL JOINT CONFERENCE ON INFORMATION AND COMMUNICATION ENGINEERING, JCICE 2024, 2024, : 71 - 76
  • [25] LSM-Subgraph: Log-Structured Merge-Subgraph for Temporal Graph Processing
    Ma, Jingyuan
    Shi, Zhan
    Liu, Shang
    Zhang, Wang
    Wu, Yutong
    Wang, Fang
    Feng, Dan
    WEB AND BIG DATA, PT I, APWEB-WAIM 2022, 2023, 13421 : 477 - 494
  • [26] Realizing Strong Determinism Contract on Log-Structured Merge Key-Value Stores
    Kwon, Miryeong
    Lee, Seungjun
    Choi, Hyunkyu
    Hwang, Jooyoung
    Jung, Myoungsoo
    ACM TRANSACTIONS ON STORAGE, 2023, 19 (02)
  • [27] SILK: Preventing Latency Spikes in Log-Structured Merge Key-Value Stores
    Balmau, Oana
    Dinu, Florin
    Zwaenepoel, Willy
    Gupta, Karan
    Chandhiramoorthi, Ravishankar
    Didona, Diego
    PROCEEDINGS OF THE 2019 USENIX ANNUAL TECHNICAL CONFERENCE, 2019, : 753 - 766
  • [28] MVLevelDB: Using Log-Structured Tree to Support Temporal Queries in IoT
    Zhao, Xiaofei
    Lam, Kam-Yiu
    Zhu, Chunjiang
    Chow, Chi-Yin
    Kuo, Tei-Wei
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (10): : 7815 - 7825
  • [29] PebblesDB: Building Key-Value Stores using Fragmented Log-Structured Merge Trees
    Raju, Pandian
    Kadekodi, Rohan
    Chidambaram, Vijay
    Abraham, Ittai
    PROCEEDINGS OF THE TWENTY-SIXTH ACM SYMPOSIUM ON OPERATING SYSTEMS PRINCIPLES (SOSP '17), 2017, : 497 - 514
  • [30] Experimental evaluation of the SMX strategy for incremental materialized path view maintenance
    Rundensteiner, EA
    Kuno, HA
    Zhou, YJ
    COMPUTER SYSTEMS SCIENCE AND ENGINEERING, 1999, 14 (06): : 331 - 342