FASTgres: Making Learned Query Optimizer Hinting Effective

被引:5
|
作者
Woltmann, Lucas [1 ]
Thiessat, Jerome [1 ]
Hartmann, Claudio [1 ]
Habich, Dirk [1 ]
Lehner, Wolfgang [1 ]
机构
[1] Tech Univ Dresden, Dresden Database Res Grp, Dresden, Germany
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2023年 / 16卷 / 11期
关键词
D O I
10.14778/3611479.3611528
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The traditional and well-established cost-based query optimizer approach enumerates different execution plans for each query, assesses each plan with costs, and selects the plan that promises the lowest costs for execution. However, the optimal execution plan is not always selected. To steer the optimizer in the right direction, many query optimizers provide configuration parameters called query optimizer hints. These hints can be set for every single query separately. To show the great potential of these hints for the optimization of analytical queries, we present results of a comprehensive and in-depth evaluation using three benchmarks and two different versions of the open-source database system PostgreSQL. In particular, we highlight that query optimizer hinting is a non-trivial challenge. To solve this challenge, we propose FASTgres, a learning-based context-aware classification strategy for hint set prediction. Compared to related work, FASTgres provides transparent and direct hint set predictions with consistent performance improvements. In our end-to-end evaluation, we demonstrate that FASTgres effectively reduces benchmark runtimes by a factor of up to 3.25x with only steering the cost-based optimizer.
引用
收藏
页码:3310 / 3322
页数:13
相关论文
共 50 条
  • [1] Neo: A Learned Query Optimizer
    Marcus, Ryan
    Negi, Parimarjan
    Mao, Hongzi
    Zhang, Chi
    Alizadeh, Mohammad
    Kraska, Tim
    Papaemmanouil, Olga
    Tatbul, Nesime
    [J]. PROCEEDINGS OF THE VLDB ENDOWMENT, 2019, 12 (11): : 1705 - 1718
  • [2] DeepO: A Learned Query Optimizer
    Sun, Luming
    Ji, Tao
    Li, Cuiping
    Chen, Hong
    [J]. PROCEEDINGS OF THE 2022 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA (SIGMOD '22), 2022, : 2421 - 2424
  • [3] AlphaQO: Robust Learned Query Optimizer
    Yu, Xiang
    Chai, Cheng-Liang
    Zhang, Xin-Ning
    Tang, Nan
    Sun, Ji
    Li, Guo-Liang
    [J]. Ruan Jian Xue Bao/Journal of Software, 2022, 33 (03): : 814 - 831
  • [4] Learned Distributed Query Optimizer:Architecture and Challenges
    GAO Jun
    HAN Yinjun
    LIN Yang
    MIAO Hao
    XU Mo
    [J]. ZTE Communications, 2024, (02) - 54
  • [5] Learned Query Optimizer: What is New and What is Next
    Zhu, Rong
    Weng, Lianggui
    Ding, Bolin
    Zhou, Jingren
    [J]. COMPANION OF THE 2024 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, SIGMOD-COMPANION 2024, 2024, : 561 - 569
  • [6] Eraser: Eliminating Performance Regression on Learned Query Optimizer
    Weng, Lianggui
    Zhu, Rong
    Wu, Di
    Ding, Bolin
    Zheng, Bolong
    Zhou, Jingren
    [J]. PROCEEDINGS OF THE VLDB ENDOWMENT, 2024, 17 (05): : 926 - 938
  • [7] Learned Optimizer for Online Approximate Query Processing in Data Exploration
    Liu, Liyuan
    Zhang, Hanbing
    Jing, Yinan
    He, Zhenying
    Zhang, Kai
    Wang, X. Sean
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (08) : 3977 - 3991
  • [8] Bao: Making Learned Query Optimization Practical
    Marcus, Ryan
    Negi, Parimarjan
    Moa, Hongzi
    Tatbul, Nesime
    Alizadeh, Mohammad
    Kraska, Tim
    [J]. SIGMOD RECORD, 2022, 51 (01) : 6 - 13
  • [9] Bao: Making Learned Query Optimization Practical
    Marcus, Ryan
    Negi, Parimarjan
    Mao, Hongzi
    Tatbul, Nesime
    Alizadeh, Mohammad
    Kraska, Tim
    [J]. SIGMOD '21: PROCEEDINGS OF THE 2021 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2021, : 1275 - 1288
  • [10] LOGER: A Learned Optimizer towards Generating Efficient and Robust Query Execution Plans
    Chen, Tianyi
    Gao, Jun
    Chen, Hedui
    Tu, Yaofeng
    [J]. PROCEEDINGS OF THE VLDB ENDOWMENT, 2023, 16 (07): : 1777 - 1789