Making Data Management Better with Vectorized Query Processing

被引:0
|
作者
Boncz, Peter [1 ,2 ]
机构
[1] CWI, Amsterdam, Netherlands
[2] MotherDuck, Amsterdam, Netherlands
关键词
D O I
10.1145/3626246.3656001
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Vectorized query processing is a query processing technique that 20 years ago was introduced in the Vectorwise database system, originally developed in the CWI database architectures research group. Nowadays, it is employed by most analytical data systems, from recent systems like DuckDB, Clickhouse, Velox, DataFusion and Polars to analytical cloud services such as Snowflake, BigQuery, Databricks and MotherDuck. The keynote will tell the story of vectorized query processing, as it evolved in research and industry over the past two decades. It will conclude with a reflection on the purpose of our research ("making data management better").
引用
收藏
页码:4 / 4
页数:1
相关论文
共 50 条
  • [1] Join Query Processing in Data Quality Management
    Yue, Mingliang
    Gao, Hong
    Shi, Shengfei
    Wang, Hongzhi
    [J]. DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2016, 2016, 9645 : 329 - 342
  • [2] Web/XML data management and query processing
    Zhou, AY
    Zheng, SH
    Qian, WN
    [J]. WORLD WIDE WEB TECHNOLOGIES IN CHINA: RESEARCH, DEVELOPMENT, AND APPLICATIONS, 2002, : 95 - 115
  • [3] Reorganizing semi-structured data for better query processing performance
    Zhou, LZ
    Wang, QK
    [J]. WORLD WIDE WEB TECHNOLOGIES IN CHINA: RESEARCH, DEVELOPMENT, AND APPLICATIONS, 2002, : 116 - 129
  • [4] Data Processing on Database Management Systems with Fuzzy Query
    Simsek, Irfan
    Topuz, Vedat
    [J]. HYBRID ARTIFICIAL INTELLIGENCE SYSTEMS, PT 1, 2010, 6076 : 170 - +
  • [5] Making better use of data: the data based management approach
    Cook, J. G.
    [J]. CATTLE PRACTICE, 2019, 27 : 79 - 82
  • [6] SciQL: A Query Language for Unified Scientific Data Processing and Management
    Chamanara, Javad
    Koenig-Ries, Birgitta
    [J]. PROCEEDINGS OF THE 5TH PH.D. WORKSHOP ON INFORMATION AND KNOWLEDGE, 2012, : 17 - 24
  • [7] Spatial Query Processing on AIS Data Streams in Data Stream Management Systems
    Brandt, Tobias
    Grawunder, Marco
    [J]. BUSINESS INFORMATION SYSTEMS WORKSHOPS, BIS 2019, 2019, 373 : 461 - 472
  • [8] Filter Representation in Vectorized Query Execution
    Ngom, Amadou
    Menon, Prashanth
    Butrovich, Matthew
    Ma, Lin
    Lim, Wan Shen
    Mowry, Todd C.
    Pavlo, Andrew
    [J]. 17TH INTERNATIONAL WORKSHOP ON DATA MANAGEMENT ON NEW HARDWARE, DAMON 2021, 2021,
  • [9] Linked Data Query Processing
    Hartig, Olaf
    Oezsu, M. Tamer
    [J]. 2014 IEEE 30TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE), 2014, : 1286 - 1289
  • [10] Data analysis for query processing
    Robinson, J
    Lowden, BGT
    [J]. ADVANCES IN INTELLIGENT DATA ANALYSIS: REASONING ABOUT DATA, 1997, 1280 : 447 - 458