Using slice join for efficient evaluation of multi-way joins

被引:5
|
作者
Lawrence, Ramon [1 ]
机构
[1] Univ British Columbia Okanagan, Kelowna, BC V1V 1V7, Canada
基金
美国国家科学基金会; 加拿大自然科学与工程研究理事会;
关键词
early join algorithm; reading policy; interactive querying; adaptive; hashing;
D O I
10.1016/j.datak.2008.06.001
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A standard hash join algorithm joins two relations at a time and requires reading the entire smaller input before results are generated. There has been recent focus on constructing join algorithms that produce results faster and can join more than two relations simultaneously. Early joins that are capable of producing results before reading the smaller relation are useful for network joins where the input arrival rates may vary as the operator can adapt without explicit query re-optimization. Multi-way joins improve performance by reducing the number of intermediate results generated and are more resilient to poor estimates by the query optimizer. The only join algorithm that combines the two features of multi-way support and early result production is limited to processing joins where all inputs are joined on the same attribute. In this work, we propose a new hash-based join algorithm called slice join. Slice join is an early, multi-way join algorithm capable of joining relations on common attributes and relations connected by a sequence of functional dependencies. Slice join is useful for a larger number of query plans, performs fewer disk operations, and has a simpler duplicate detection technique than previous approaches. Experimental results demonstrate that slice join outperforms other multi-way join operators and binary join plans. (C) 2008 Elsevier B.V. All rights reserved.
引用
收藏
页码:118 / 139
页数:22
相关论文
共 50 条
  • [21] MML inference of decision graphs with multi-way joins
    Tan, PJ
    Dowe, DL
    AL 2002: ADVANCES IN ARTIFICIAL INTELLIGENCE, 2002, 2557 : 131 - 142
  • [22] Graph partition based multi-way spatial joins
    Lin, XM
    Lu, HX
    Zhang, Q
    IDEAS 2002: INTERNATIONAL DATABASE ENGINEERING AND APPLICATIONS SYMPOSIUM, PROCEEDINGS, 2002, : 23 - 32
  • [23] Query processing of multi-way stream window joins
    Moustafa A. Hammad
    Walid G. Aref
    Ahmed K. Elmagarmid
    The VLDB Journal, 2008, 17 : 469 - 488
  • [24] On estimating result sizes of multi-way spatial joins
    Park, HH
    COMPUTATIONAL SCIENCE AND ITS APPLICATIONS - ICCA 2003, PT 3, PROCEEDINGS, 2003, 2669 : 856 - 865
  • [25] Query processing of multi-way stream window joins
    Hammad, Moustafa A.
    Aref, Walid G.
    Elmagarmid, Ahmed K.
    VLDB JOURNAL, 2008, 17 (03): : 469 - 488
  • [26] Scaling Out Multi-Way Stream Joins using Optimized, Iterative Probing
    Dossinger, Manuel
    Michel, Sebastian
    2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2019, : 449 - 456
  • [27] Multi-way distance join queries in spatial databases
    Corral, A
    Manolopoulos, Y
    Theodoridis, Y
    Vassilakopoulos, M
    GEOINFORMATICA, 2004, 8 (04) : 373 - 402
  • [28] Multi-Way Distance Join Queries in Spatial Databases
    Antonio Corral
    Yannis Manolopoulos
    Yannis Theodoridis
    Michael Vassilakopoulos
    GeoInformatica, 2004, 8 : 373 - 402
  • [29] Optimizing Multi-Way Spatial Joins of Web Feature Services
    Lan, Guiwen
    Zhang, Qiang
    Yang, Zhao
    Li, Tong
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2017, 6 (04)
  • [30] Evaluating Multi-Way Joins over Discounted Hitting Time
    Zhang, Wangda
    Cheng, Reynold
    Kao, Ben
    2014 IEEE 30TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE), 2014, : 724 - 735