Efficient Incremental Computation of Aggregations over Sliding Windows

被引:5
|
作者
Zhang, Chao [1 ]
Akbarinia, Reza [2 ]
Toumani, Farouk [1 ]
机构
[1] Univ Clermont Auvergne, CNRS, LIMOS, Clermont Ferrand, France
[2] Univ Montpellier, INRIA, LIRMM, Montpellier, France
关键词
Data Stream; Streaming Algorithm; Sliding Window Aggregation;
D O I
10.1145/3447548.3467360
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Computing aggregation over sliding windows, i.e., finite subsets of an unbounded stream, is a core operation in streaming analytics. We propose PBA (Parallel Boundary Aggregator), a novel parallel algorithm that groups continuous slices of streaming values into chunks and exploits two buffers, cumulative slice aggregations and left cumulative slice aggregations, to compute sliding window aggregations efficiently. PBA runs in O(1) time, performing at most 3 merging operations per slide while consuming O(n) space for windows with n partial aggregations. Our empirical experiments demonstrate that PBA can improve throughput up to 4x while reducing latency, compared to state-of-the-art algorithms.
引用
收藏
页码:2136 / 2144
页数:9
相关论文
共 50 条
  • [1] Stabbing the sky: Efficient skyline computation over sliding windows
    Lin, XM
    Yuan, YD
    Wang, W
    Lu, HJ
    [J]. ICDE 2005: 21ST INTERNATIONAL CONFERENCE ON DATA ENGINEERING, PROCEEDINGS, 2005, : 502 - 513
  • [2] Reverse Skyline Computation over Sliding Windows
    Xin, Junchang
    Wang, Zhiqiong
    Bai, Mei
    Wang, Guoren
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2015, 2015
  • [3] Greedily computing associative aggregations on sliding windows
    Basin, David
    Klaedtke, Felix
    Zalinescu, Eugen
    [J]. INFORMATION PROCESSING LETTERS, 2015, 115 (02) : 186 - 192
  • [4] Efficient Representative Subset Selection over Sliding Windows
    Wang, Yanhao
    Li, Yuchen
    Tan, Kian-Lee
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2019, 31 (07) : 1327 - 1340
  • [5] Incremental mining of closed inter-transaction itemsets over data stream sliding windows
    Chiu, Shih-Chuan
    Li, Hua-Fu
    Huang, Jiun-Long
    You, Hsin-Han
    [J]. JOURNAL OF INFORMATION SCIENCE, 2011, 37 (02) : 208 - 220
  • [6] DenForest: Enabling Fast Deletion in Incremental Density-Based Clustering over Sliding Windows
    Kim, Bogyeong
    Koo, Kyoseung
    Enkhbat, Undraa
    Moon, Bongki
    [J]. PROCEEDINGS OF THE 2022 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA (SIGMOD '22), 2022, : 296 - 309
  • [7] Efficient Identification of TOP-K Heavy Hitters over Sliding Windows
    Haina Tang
    Yulei Wu
    Tong Li
    Chunjing Han
    Jingguo Ge
    Xiangpeng Zhao
    [J]. Mobile Networks and Applications, 2019, 24 : 1732 - 1741
  • [8] Efficient Reverse Skyline Processing over Sliding Windows in Wireless Sensor Networks
    Min, Jun-Ki
    [J]. INTERNATIONAL JOURNAL OF DISTRIBUTED SENSOR NETWORKS, 2015,
  • [10] Efficient Identification of TOP-K Heavy Hitters over Sliding Windows
    Tang, Haina
    Wu, Yulei
    Li, Tong
    Han, Chunjing
    Ge, Jingguo
    Zhao, Xiangpeng
    [J]. MOBILE NETWORKS & APPLICATIONS, 2019, 24 (05): : 1732 - 1741