Efficient Processing of Window Functions in Analytical SQL Queries

被引:22
|
作者
Leis, Viktor [1 ]
Kundhikanjana, Kan [1 ]
Kemper, Alfons [1 ]
Neumann, Thomas [1 ]
机构
[1] Tech Univ Munich, D-80290 Munich, Germany
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2015年 / 8卷 / 10期
关键词
D O I
10.14778/2794367.2794375
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Window functions, also known as analytic OLAP functions, have been part of the SQL standard for more than a decade and are now a widely-used feature. Window functions allow to elegantly express many useful query types including time series analysis, ranking, percentiles, moving averages, and cumulative sums. Formulating such queries in plain SQL-92 is usually both cumbersome and inefficient. Despite being supported by all major database systems, there have been few publications that describe how to implement an efficient relational window operator. This work aims at filling this gap by presenting an efficient and general algorithm for the window operator. Our algorithm is optimized for high-performance main-memory database systems and has excellent performance on modern multi-core CPUs. We show how to fully parallelize all phases of the operator in order to effectively scale for arbitrary input distributions.
引用
收藏
页码:1058 / 1069
页数:12
相关论文
共 50 条
  • [1] Holistic Shuffler for the Parallel Processing of SQL Window Functions
    Coelho, Fabio
    Pereira, Jose
    Vilaca, Ricardo
    Oliveira, Rui
    DISTRIBUTED APPLICATIONS AND INTEROPERABLE SYSTEMS, DAIS 2016, 2016, 9687 : 75 - 81
  • [2] Efficient Execution of User-Defined Functions in SQL Queries
    Foufoulas, Yannis
    Simitsis, Alkis
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2023, 16 (12): : 3874 - 3877
  • [3] Efficient processing of nested fuzzy SQL queries in a fuzzy database
    Yang, Q
    Zhang, WN
    Liu, CW
    Wu, J
    Yu, C
    Nakajima, H
    Rishe, ND
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2001, 13 (06) : 884 - 901
  • [4] Reducing Data Transfer in Parallel Processing of SQL Window Functions
    Coelho, Fabio
    Pereira, Jose
    Vilaca, Ricardo
    Oliveira, Rui
    PROCEEDINGS OF THE 6TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND SERVICES SCIENCE, VOL 1 (CLOSER), 2016, : 343 - 347
  • [5] EFFICIENT SECONDARY MEMORY PROCESSING OF WINDOW QUERIES ON SPATIAL DATA
    NARDELLI, E
    PROIETTI, G
    INFORMATION SCIENCES, 1995, 84 (1-2) : 67 - 83
  • [6] Efficient Parallel Processing of Analytical Queries on Linked Data
    Hagedorn, Stefan
    Sattler, Kai-Uwe
    ON THE MOVE TO MEANINGFUL INTERNET SYSTEMS: OTM 2013 CONFERENCES, 2013, 8185 : 452 - 469
  • [7] Processing fuzzy SQL queries with flat, context-dependent and multidimensional membership functions
    Malysiak, B
    Mrozek, D
    Kozielski, S
    Proceedings of the IASTED International Conference on Computational Intelligence, 2005, : 36 - 41
  • [8] Efficient Evaluation of Arbitrarily-Framed Holistic SQL Aggregates and Window Functions
    Vogelsgesang, Adrian
    Neumann, Thomas
    Leis, Viktor
    Kemper, Alfons
    PROCEEDINGS OF THE 2022 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA (SIGMOD '22), 2022, : 1243 - 1256
  • [9] Synthesizing Analytical SQL Queries from Computation Demonstration
    Zhou, Xiangyu
    Bodik, Rastislav
    Cheung, Alvin
    Wang, Chenglong
    PROCEEDINGS OF THE 43RD ACM SIGPLAN INTERNATIONAL CONFERENCE ON PROGRAMMING LANGUAGE DESIGN AND IMPLEMENTATION (PLDI '22), 2022, : 168 - 182
  • [10] An efficient processing of queries with joins and aggregate functions in data warehousing environment
    Kim, JH
    Kim, YH
    Kim, SW
    Ok, SH
    13TH INTERNATIONAL WORKSHOP ON DATABASE AND EXPERT SYSTEMS APPLICATIONS, PROCEEDINGS, 2002, : 785 - 791