Cost-based solution for optimizing multi-join queries over distributed streaming sensor data

被引:0
|
作者
Gomes, Joseph [1 ]
Choi, Hyeong-Ah [1 ]
机构
[1] George Washington Univ, Dept Comp Sci, Washington, DC 20052 USA
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sensors are envisioned to be at the center of distributed collaborative computing services involving time-critical decision support. Sensors are small devices with limited communication and computational capabilities that collect data on their neighboring physical world and send the data periodically to server machines. Sensors form a collaborative network with these servers, where the sensors gather information and the servers perform various operations (e.g. filter, aggregate, join etc) on the information streams in real-time according to predefined queries or rules. Sensor data streams are continuous, un-ending and have highly volatile characteristics. As a result, traditional database systems are inappropriate for handling queries for sensor streams, and several stream data management systems have been proposed in the literature. In this paper we focus on a special type of query, namely join queries, which is the most expensive query operator. Here, we address the problem of finding an optimal join tree that maximizes throughput for sliding window based multi-join queries over continuous sensor data streams. We present a polynomial time algorithm Fodp and three variants of Fodp. Our experiments in ARES(1). show that for almost all instances, trees from Fodp and its variants perform close to the optimal trees from our exponential time algorithm OptDP [1], and significantly better than existing XJoin based heuristic algorithms.
引用
收藏
页码:282 / +
页数:3
相关论文
共 50 条
  • [41] Progressive Genetic Evolutions-Based Join Cost Optimization (PGE-JCO) for Distributed RDF Chain Queries
    Shailaja, K.
    Kumar, P. V.
    Bhavani, S. Durga
    [J]. PROCEEDINGS OF THE FIRST INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND INFORMATICS, ICCII 2016, 2017, 507 : 231 - 244
  • [42] Grid-Based Parallel Algorithms of Join Queries for Analyzing Multi-Dimensional Data on MapReduce
    Jang, Miyoung
    Chang, Jae-Woo
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2018, E101D (04): : 964 - 976
  • [43] Distributed Similarity Join Over Data Streams Based on Earth Mover's Distance
    Xu, Jia
    Song, Chao
    Lv, Pin
    Li, Tao-Shen
    [J]. Jisuanji Xuebao/Chinese Journal of Computers, 2019, 42 (08): : 1779 - 1796
  • [44] Handling distributed XML queries over large XML data based on MapReduce framework
    Fan, Hongjie
    Ma, Zhiyi
    Wang, Dianhui
    Liu, Junfei
    [J]. INFORMATION SCIENCES, 2018, 453 : 1 - 20
  • [45] Approximate Continuous Top-K Queries over Memory Limitation-Based Streaming Data
    Zhu, Rui
    Meng, Liu
    Wang, Bin
    Yang, Xiaochun
    Xia, Xiufeng
    [J]. DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2022, PT I, 2022, : 3 - 20
  • [46] A Method for Automatically Generating Join Queries Based on Relations-Attributes Distance Matrix over Data Lakes
    Zhang, Caicai
    Lu, Chenglang
    Mei, Zhuolin
    Wu, Bin
    Yu, Jing
    [J]. TEHNICKI VJESNIK-TECHNICAL GAZETTE, 2023, 30 (05): : 1539 - 1546
  • [47] Distributed Filter Based on SICI Data Compression over Sensor Networks
    Shen, Yuqing
    Sun, Shuli
    [J]. 2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 4726 - 4731
  • [48] Distributed, multi-user, multi-application, and multi-sensor data fusion over named data networks
    Bandara, H. M. N. Dilum
    Jayasumana, Anura P.
    [J]. COMPUTER NETWORKS, 2013, 57 (16) : 3235 - 3248
  • [49] Cost-effective Distributed Edge vehicle selection for Multi-tier Video streaming over Vehicular network
    Chowdhury, Debanjan Roy
    Nandi, Sukumar
    Goswami, Diganta
    [J]. PROCEEDINGS OF THE 2022 47TH IEEE CONFERENCE ON LOCAL COMPUTER NETWORKS (LCN 2022), 2022, : 227 - 232
  • [50] Distributed estimation based on weighted data aggregation over delayed sensor networks
    Adachi, Ryosuke
    Yamashita, Yuh
    Kobayashi, Koichi
    [J]. IFAC JOURNAL OF SYSTEMS AND CONTROL, 2020, 14