Relatively effective and practical load shedding strategy for sliding-window join queries over data streams

被引:0
|
作者
Northwestern Polytechnical University, Xi'an 710072, China [1 ]
不详 [2 ]
机构
来源
Xibei Gongye Daxue Xuebao | 2006年 / 5卷 / 595-599期
关键词
Data handling - Information retrieval - Semantics;
D O I
暂无
中图分类号
学科分类号
摘要
We now present a new strategy quite effective and practical for shedding load from sliding-window join queries over data streams. We propose the problem description, sliding-window join queries, a load shedding strategy based on the partition of the domain of join attributes. The schematic shows how to execute the strategy with two operator modules X1 and X2. The strategy is essentially that the domain of the join attributes is partitioned into certain sub-domains, and tuples are dropped according to their join values by maintaining simple data stream statistics. We performed two experiments. One is concerned with the effect of different skew parameters of zipf distribution, the other is concerned with the effect of different overloadings. Results of experiments are shown in the paper. Our new strategy needs fewer statistics of input data streams and it makes it convenient to further process the outputs of join operation. It also has good adaptability for different skew parameters of zipf distribution and different peak loads. The theoretical analysis and experiments show preliminarily that the new load shedding strategy is effective and efficient for window join queries.
引用
收藏
相关论文
共 50 条
  • [21] Supporting sliding window queries for continuous data streams
    Qiao, L
    Agrawal, D
    El Abbadi, A
    SSDBM 2002: 15TH INTERNATIONAL CONFERENCE ON SCIENTIFIC AND STATISTICAL DATABASE MANAGEMENT, 2003, : 85 - 94
  • [22] Research on sliding window join semantics and join algorithm in heterogeneous data streams
    Du, Wei
    Zou, Xianxia
    Open Cybernetics and Systemics Journal, 2015, 9 : 556 - 564
  • [23] Load shedding for window joins on multiple data streams
    Law, Yan-Nei
    Zaniolo, Carlo
    2007 IEEE 23RD INTERNATIONAL CONFERENCE ON DATA ENGINEERING WORKSHOP, VOLS 1-2, 2007, : 674 - +
  • [24] Sketch-based Querying of Distributed Sliding-Window Data Streams
    Papapetrou, Odysseas
    Garofalakis, Minos
    Deligiannakis, Antonios
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2012, 5 (10): : 992 - 1003
  • [25] Transformation of continuous aggregation join queries over data streams
    Tran, Tri Minh
    Lee, Byung Suk
    ADVANCES IN SPATIAL AND TEMPORAL DATABASES, PROCEEDINGS, 2007, 4605 : 330 - +
  • [27] Parallelizing skyline queries over uncertain data streams with sliding window partitioning and grid index
    Li, Xiaoyong
    Wang, Yijie
    Li, Xiaoling
    Wang, Yuan
    KNOWLEDGE AND INFORMATION SYSTEMS, 2014, 41 (02) : 277 - 309
  • [28] Parallelizing skyline queries over uncertain data streams with sliding window partitioning and grid index
    Xiaoyong Li
    Yijie Wang
    Xiaoling Li
    Yuan Wang
    Knowledge and Information Systems, 2014, 41 : 277 - 309
  • [29] HEE-Sketch: an Efficient Sketch for Sliding-Window Frequency Estimation over Skewed Data Streams
    Sun, Shuhao
    Zheng, Jingwei
    Li, Dagang
    2019 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2019), 2019, : 736 - 743
  • [30] Data Streams Join Aggregate Algorithms Based on Compound Sliding Window
    Zhong, Yingli
    Wang, Weiping
    Guo, Longjiang
    FIRST INTERNATIONAL WORKSHOP ON DATABASE TECHNOLOGY AND APPLICATIONS, PROCEEDINGS, 2009, : 426 - +