To Share, or not to Share Online Event Trend Aggregation Over Bursty Event Streams

被引:6
|
作者
Poppe, Olga [1 ]
Lei, Chuan [2 ]
Ma, Lei [3 ]
Rozet, Allison [4 ]
Rundensteiner, Elke A. [3 ]
机构
[1] Microsoft Gray Syst Lab, One Microsoft Way, Redmond, WA 98052 USA
[2] IBM Res Almaden, 650 Harry Rd, San Jose, CA 95120 USA
[3] Worcester Polytech Inst, 100 Inst Rd, Worcester, MA 01609 USA
[4] MathWorks, 1 Apple Hill Dr, Natick, MA 01760 USA
关键词
Complex Event Processing; query optimization; computation sharing; incremental aggregation; event trend;
D O I
10.1145/3448016.3452785
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Complex event processing (CEP) systems continuously evaluate large workloads of pattern queries under tight time constraints. Event trend aggregation queries with Kleene patterns are commonly used to retrieve summarized insights about the recent trends in event streams. State-of-art methods are limited either due to repetitive computations or unnecessary trend construction. Existing shared approaches are guided by statically selected and hence rigid sharing plans that are often sub-optimal under stream fluctuations. In this work, we propose a novel framework HAMLET that is the first to overcome these limitations. HAMLET introduces two key innovations. First, HAMLET adaptively decides at run time whether to share or not to share computations depending on the current stream properties to harvest the maximum sharing benefit. Second, HAMLET is equipped with a highly efficient shared trend aggregation strategy that avoids trend construction. Our experimental study on both real and synthetic data sets demonstrates that HAMLET consistently reduces query latency by up to five orders of magnitude compared to state-of-the-art approaches.
引用
收藏
页码:1452 / 1464
页数:13
相关论文
共 50 条
  • [1] Bursty Event Detection in Twitter Streams
    Comito, Carmela
    Forestiero, Agostino
    Pizzuti, Clara
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2019, 13 (04)
  • [3] Online event recognition over noisy data streams
    Mantenoglou, Periklis
    Artikis, Alexander
    Paliouras, Georgios
    INTERNATIONAL JOURNAL OF APPROXIMATE REASONING, 2023, 161
  • [4] Online Bursty Event Detection from Microblog
    Li, Jianxin
    Tai, Zhenying
    Zhang, Richong
    Yu, Weiren
    Liu, Lu
    2014 IEEE/ACM 7TH INTERNATIONAL CONFERENCE ON UTILITY AND CLOUD COMPUTING (UCC), 2014, : 865 - 870
  • [5] The Event Study of Split Share Structure Reform
    Li Pu
    Zhang Qi
    RECENT ADVANCE IN STATISTICS APPLICATION AND RELATED AREAS, VOLS I AND II, 2009, : 1318 - 1323
  • [6] Event Trend Aggregation Under Rich Event Matching Semantics
    Poppe, Olga
    Lei, Chuan
    Rundensteiner, Elke A.
    Maier, David
    SIGMOD '19: PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2019, : 555 - 572
  • [7] Complete Event Trend Detection in High-Rate Event Streams
    Poppe, Olga
    Lei, Chuan
    Ahmed, Salah
    Rundensteiner, Elke A.
    SIGMOD'17: PROCEEDINGS OF THE 2017 ACM INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2017, : 109 - 124
  • [8] Active Complex Event Processing over Event Streams
    Wang, Di
    Rundensteiner, Elke A.
    Ellison, Richard T., III
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2011, 4 (10): : 634 - 645
  • [9] A Novel Method for Online Bursty Event Detection on Twitter
    Zhang, Yu
    Qu, Zhiyi
    PROCEEDINGS OF 2015 6TH IEEE INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE, 2015, : 284 - 288
  • [10] Efficient Complete Event Trend Detection over High-Velocity Streams
    Mei, Huiyao
    Chen, Hanhua
    Jin, Hai
    Hua, Qiang-Sheng
    Zhou, Bing Bing
    50TH INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING, 2021,