An adaptive join strategy in distributed data stream management system

被引:0
|
作者
Li, Xiaojing [1 ]
Gu, Yu [1 ]
Yue, Dejun [1 ]
Yu, Ge [1 ]
机构
[1] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110004, Peoples R China
关键词
distributed data stream management; continuous query; adaptive join;
D O I
10.1109/CIS.2007.55
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As data stream springs up in various areas, distributed data stream management systems are being paid more and more attention. In DSMS, join is one of the most common but complicated operators, and the efficiency of continuous queries may be influenced by join directly. This paper mainly studies the join operation over data stream located on two different sites in WAN. Firstly, data model, query model and cost model are defined, and then a simple direct-join strategy and a semi-join strategy are proposed, which are respectively ideal under certain conditions but can't adapt to the variation of data stream. Finally, based on the analysis of the two strategies, an optimized adaptive join strategy is presented. The efficiency and flexibility of our strategy is proved by extensive experiments.
引用
收藏
页码:271 / +
页数:2
相关论文
共 50 条
  • [1] Adaptive scheduling strategy for data stream management system
    Sun, Guangzhong
    Zhou, Yipeng
    Huang, Yu
    Zhou, Yinghua
    ADVANCES IN DATA AND WEB MANAGEMENT, PROCEEDINGS, 2007, 4505 : 511 - +
  • [2] Nereus: A Distributed Stream Band Join System With Adaptive Range Partitioning
    Yu, Shuiying
    Chen, Hanhua
    Jin, Hai
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2023, 69 (04) : 949 - 961
  • [3] Distributed Adaptive Windowed Stream Join Processing
    Tri Minh Tran
    Lee, Byung Suk
    INTERNATIONAL JOURNAL OF DISTRIBUTED SYSTEMS AND TECHNOLOGIES, 2011, 2 (02) : 59 - 81
  • [4] Load Adaptive Distributed Stream Processing System for Explosive Stream Data
    Lee, Myungcheol
    Lee, Miyoung
    Hur, Sung Jin
    Kim, Ikkyun
    2015 17TH INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION TECHNOLOGY (ICACT), 2015, : 753 - 757
  • [5] An adaptive load balancing strategy for stateful join operator in skewed data stream environments
    Sun, Dawei
    Zhang, Chunlin
    Gao, Shang
    Buyya, Rajkumar
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 152 : 138 - 151
  • [6] A-DSP: An Adaptive Join Algorithm for Dynamic Data Stream on Cloud System
    Fang, Junhua
    Zhang, Rong
    Zhao, Yan
    Zheng, Kai
    Zhou, Xiaofang
    Zhou, Aoying
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2021, 33 (05) : 1861 - 1876
  • [7] Scalable and Adaptive Joins for Trajectory Data in Distributed Stream System
    Fang, Jun-Hua
    Zhao, Peng-Peng
    Liu, An
    Li, Zhi-Xu
    Zhao, Lei
    JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2019, 34 (04) : 747 - 761
  • [8] Scalable and Adaptive Joins for Trajectory Data in Distributed Stream System
    Jun-Hua Fang
    Peng-Peng Zhao
    An Liu
    Zhi-Xu Li
    Lei Zhao
    Journal of Computer Science and Technology, 2019, 34 : 747 - 761
  • [9] An adaptive non-migrating load-balanced distributed stream window join system
    Wang, Qihang
    Zuo, Decheng
    Zhang, Zhan
    Chen, Siyuan
    Liu, Tianming
    JOURNAL OF SUPERCOMPUTING, 2023, 79 (08): : 8236 - 8264
  • [10] An adaptive non-migrating load-balanced distributed stream window join system
    Qihang Wang
    Decheng Zuo
    Zhan Zhang
    Siyuan Chen
    Tianming Liu
    The Journal of Supercomputing, 2023, 79 : 8236 - 8264