Parallel Continuous Preference Queries over Out-of-Order and Bursty Data Streams

被引:11
|
作者
Mencagli, Gabriele [1 ]
Torquati, Massimo [1 ]
Danelutto, Marco [1 ]
De Matteis, Tiziano [1 ]
机构
[1] Univ Pisa, Dept Comp Sci, I-56126 Pisa, Italy
关键词
Parallelism; multicores; data streams; continuous preference queries; sliding windows; out-of-order arrivals; burstiness and traffic surges;
D O I
10.1109/TPDS.2017.2679197
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Techniques to handle traffic bursts and out-of-order arrivals are of paramount importance to provide real-time sensor data analytics in domains like traffic surveillance, transportation management, healthcare and security applications. In these systems the amount of raw data coming from sensors must be analyzed by continuous queries that extract value-added information used to make informed decisions in real-time. To perform this task with timing constraints, parallelism must be exploited in the query execution in order to enable the real-time processing on parallel architectures. In this paper we focus on continuous preference queries, a representative class of continuous queries for decision making, and we propose a parallel query model targeting the efficient processing over out-of-order and bursty data streams. We study how to integrate punctuation mechanisms in order to enable out-of-order processing. Then, we present advanced scheduling strategies targeting scenarios with different burstiness levels, parameterized using the index of dispersion quantity. Extensive experiments have been performed using synthetic datasets and real-world data streams obtained from an existing real-time locating system. The experimental evaluation demonstrates the efficiency of our parallel solution and its effectiveness in handling the out-of-orderness degrees and burstiness levels of real-world applications.
引用
收藏
页码:2608 / 2624
页数:17
相关论文
共 50 条
  • [1] Quality-Driven Continuous Query Execution over Out-of-Order Data Streams
    Ji, Yuanzhen
    Zhou, Hongjin
    Jerzak, Zbigniew
    Nica, Anisoara
    Hackenbroich, Gregor
    Fetzer, Christof
    [J]. SIGMOD'15: PROCEEDINGS OF THE 2015 ACM SIGMOD INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2015, : 889 - 894
  • [2] Parallel processing of continuous queries over data streams
    Safaei, Ali A.
    Haghjoo, Mostafa S.
    [J]. DISTRIBUTED AND PARALLEL DATABASES, 2010, 28 (2-3) : 93 - 118
  • [3] Parallel processing of continuous queries over data streams
    Ali A. Safaei
    Mostafa S. Haghjoo
    [J]. Distributed and Parallel Databases, 2010, 28 : 93 - 118
  • [4] Runtime Verification over Out-of-order Streams
    Basin, David
    Klaedtke, Felix
    Zalinescu, Eugen
    [J]. ACM TRANSACTIONS ON COMPUTATIONAL LOGIC, 2020, 21 (01)
  • [5] Runtime Verification of Temporal Properties over Out-of-Order Data Streams
    Basin, David
    Klaedtke, Felix
    Zalinescu, Eugen
    [J]. COMPUTER AIDED VERIFICATION, CAV 2017, PT I, 2017, 10426 : 356 - 376
  • [6] An Improved BP Algorithm over Out-of-order Streams for Big Data
    Wang, Kun
    Zhuo, Linchao
    Lu, Heng
    Guo, Huang
    Xu, Lili
    Zhang, Yuhua
    [J]. 2013 8TH INTERNATIONAL ICST CONFERENCE ON COMMUNICATIONS AND NETWORKING IN CHINA (CHINACOM), 2013, : 840 - 845
  • [7] Continuous Processing of Preference Queries in Data Streams
    Kontaki, Maria
    Papadopoulos, Apostolos N.
    Manolopoulos, Yannis
    [J]. SOFSEM 2010: THEORY AND PRACTICE OF COMPUTER SCIENCE, PROCEEDINGS, 2010, 5901 : 47 - 60
  • [8] Continuous queries over data streams
    Babu, S
    Widom, J
    [J]. SIGMOD RECORD, 2001, 30 (03) : 109 - 120
  • [9] Poster: Generating Reproducible Out-of-Order Data Streams
    Grulich, Philipp M.
    Traub, Jonas
    Bress, Sebastian
    Katsifodimos, Asterios
    Markl, Volker
    Rabl, Tilmann
    [J]. DEBS'19: PROCEEDINGS OF THE 13TH ACM INTERNATIONAL CONFERENCE ON DISTRIBUTED AND EVENT-BASED SYSTEMS, 2019, : 256 - 257
  • [10] Out-of-order Execution of Database Queries
    Goda, Kazuo
    Hayamizu, Yuto
    Yamada, Hiroyuki
    Kitsuregawa, Masaru
    [J]. PROCEEDINGS OF THE VLDB ENDOWMENT, 2020, 13 (12): : 3489 - 3501