Efficiently Monitoring Top-k Pairs over Sliding Windows

被引:13
|
作者
Shen, Zhitao [1 ]
Cheema, Muhammad Aamir [1 ]
Lin, Xuemin [1 ,2 ]
Zhang, Wenjie [1 ]
Wang, Haixun [3 ]
机构
[1] Univ New S Wales, Sydney, NSW 2052, Australia
[2] East China Normal Univ, Shanghai, Peoples R China
[3] Microsoft Res Asia, Beijing, Peoples R China
关键词
D O I
10.1109/ICDE.2012.89
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Top-k pairs queries have received significant attention by the research community. k-closest pairs queries, k-furthest pairs queries and their variants are among the most well studied special cases of the top-k pairs queries. In this paper, we present the first approach to answer a broad class of top-k pairs queries over sliding windows. Our framework handles multiple top-k pairs queries and each query is allowed to use a different scoring function, a different value of k and a different size of the sliding window. Although the number of possible pairs in the sliding window is quadratic to the number of objects N in the sliding window, we efficiently answer the top-k pairs query by maintaining a small subset of pairs called K-skyband which is expected to consist of O(K log(N/K)) pairs. For all the queries that use the same scoring function, we need to maintain only one K-skyband. We present efficient techniques for the K-skyband maintenance and query answering. We conduct a detailed complexity analysis and show that the expected cost of our approach is reasonably close to the lower bound cost. We experimentally verify this by comparing our approach with a specially designed supreme algorithm that assumes the existence of an oracle and meets the lower bound cost.
引用
收藏
页码:798 / 809
页数:12
相关论文
共 50 条
  • [1] A Generic Framework for Top-k Pairs and Top-k Objects Queries over Sliding Windows
    Shen, Zhitao
    Cheema, Muhammad Aamir
    Lin, Xuemin
    Zhang, Wenjie
    Wang, Haixun
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2014, 26 (06) : 1349 - 1366
  • [2] Efficient Identification of TOP-K Heavy Hitters over Sliding Windows
    Haina Tang
    Yulei Wu
    Tong Li
    Chunjing Han
    Jingguo Ge
    Xiangpeng Zhao
    [J]. Mobile Networks and Applications, 2019, 24 : 1732 - 1741
  • [3] Efficient Identification of TOP-K Heavy Hitters over Sliding Windows
    Tang, Haina
    Wu, Yulei
    Li, Tong
    Han, Chunjing
    Ge, Jingguo
    Zhao, Xiangpeng
    [J]. MOBILE NETWORKS & APPLICATIONS, 2019, 24 (05): : 1732 - 1741
  • [4] Sliding Window Top-K Monitoring over Distributed Data Streams
    Lv, Zhijin
    Chen, Ben
    Yu, Xiaohui
    [J]. WEB AND BIG DATA, APWEB-WAIM 2017, PT I, 2017, 10366 : 527 - 540
  • [5] Sliding Window Top-K Monitoring over Distributed Data Streams
    Chen B.
    Lv Z.
    Yu X.
    Liu Y.
    [J]. Data Science and Engineering, 2017, 2 (4) : 289 - 300
  • [6] Top-k Frequent Items and Item Frequency Tracking over Sliding Windows of Any Sizes
    Song, Chunyao
    Liu, Xuanming
    Ge, Tingjian
    [J]. 2017 IEEE 33RD INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2017), 2017, : 199 - 202
  • [7] Top-k frequent items and item frequency tracking over sliding windows of any size
    Song, Chunyao
    Liu, Xuanming
    Ge, Tingjian
    Ge, Yao
    [J]. INFORMATION SCIENCES, 2019, 475 : 100 - 120
  • [8] Geo-Social Keyword Top-k Data Monitoring over Sliding Window
    Nishio, Shunya
    Amagata, Daichi
    Hara, Takahiro
    [J]. DATABASE AND EXPERT SYSTEMS APPLICATIONS, DEXA 2017, PT I, 2017, 10438 : 409 - 424
  • [9] Scaling the monitoring of approximate top-k queries in streaming windows
    Ramperez, Victor
    Zahmatkesh, Shima
    Della Valle, Emanuele
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2021, : 181 - 189
  • [10] Approximate Continuous Top-k Query over Sliding Window
    Zhu, Rui
    Wang, Bin
    Luo, Shi-Ying
    Yang, Xiao-Chun
    Wang, Guo-Ren
    [J]. JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2017, 32 (01) : 93 - 109