QMapper: A Tool for SQL Optimization on Hive Using Query Rewriting

被引：0

作者：

Xu, Yingzhong ^{[1
,2
,3
]}

Hu, Songlin ^{[2
,3
]}

机构：

[1] Univ Chinese Acad Sci, Beijing, Peoples R China

[2] Chinese Acad Sci, Inst Comp Technol, Beijing, Peoples R China

[3] Wuhan Univ, State Key Lab Software Engn, Wuhan, Peoples R China

来源：

PROCEEDINGS OF THE 22ND INTERNATIONAL CONFERENCE ON WORLD WIDE WEB (WWW'13 COMPANION) | 2013年

基金：

中国国家自然科学基金;

关键词：

SQL; Hive; MapReduce; Query Rewriting;

D O I：

暂无

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

Although HiveQL offers similar features with SQL, it is stil-1 difficult to map complex SQL queries into HiveQL and manual translation often leads to poor performance. A tool named QMapper is developed to address this problem by utilizing query rewriting rules and cost-based MapReduce flow evaluation on the basis of column statistics. Evaluation demonstrates that while assuring the correctness, QMapper improves the performance up to 42% in terms of execution time.

引用

页码：211 / 212

页数：2

共 50 条

[1] QMapper for Smart Grid: Migrating SQL-based Application to Hive
Wang, Yue
Xu, Yingzhong
Liu, Yue
Chen, Jian
Hu, Songlin
[J]. SIGMOD'15: PROCEEDINGS OF THE 2015 ACM SIGMOD INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2015, : 647 - 658
[2] A Robust Optimization Approach of SQL-to-SPARQL Query Rewriting
Ahmed, Abatal
Bahaj, Mohamed
Nassima, Soussi
[J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2019, 10 (11) : 538 - 543
[3] Query Optimization Using Column Statistics in Hive
Gruenheid, Anja
Omiecinski, Edward
Mark, Leo
[J]. PROCEEDINGS OF THE 15TH INTERNATIONAL DATABASE ENGINEERING & APPLICATIONS SYMPOSIUM (IDEAS '11), 2011, : 97 - 105
[4] SQL QUERY TUNING AND OPTIMIZATION : AN EXAMPLE USING AWS
Dikovic, Jasmina
Panev, Ida
[J]. ZBORNIK VELEUCILISTA U RIJECI-JOURNAL OF THE POLYTECHNICS OF RIJEKA, 2023, 11 (01): : 289 - 310
[5] An efficient Join-Engine to the SQL query based on Hive with Hbase
Zhao Zhi-cheng
Jiang Yi
[J]. PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON APPLIED SCIENCE AND ENGINEERING INNOVATION, 2015, 12 : 991 - 996
[6] Query rewriting for semantic query optimization in spatial databases
Mella, Eduardo
Andrea Rodriguez, M.
Bravo, Loreto
Gatica, Diego
[J]. GEOINFORMATICA, 2019, 23 (01) : 79 - 104
[7] Query rewriting for semantic query optimization in spatial databases
Eduardo Mella
M. Andrea Rodríguez
Loreto Bravo
Diego Gatica
[J]. GeoInformatica, 2019, 23 : 79 - 104
[8] Multiple query optimization approach based on hive
Han, Ying
Yu, Xiao Qiang
Li, Xu
Yao, Chun Long
Zhao, Xin
[J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2018, 35 (01) : 47 - 53
[9] Query Rewriting and Optimization for Ontological Databases
Gottlob, Georg
Orsi, Giorgio
Pieris, Andreas
[J]. ACM TRANSACTIONS ON DATABASE SYSTEMS, 2014, 39 (03):
[10] RDF Multi-query Optimization Algorithm for Query Rewriting Using Common Subgraphs
Wang, Manzi
Fu, Haidong
Xu, Fangfang
[J]. PROCEEDINGS OF THE THIRD INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND APPLICATION ENGINEERING (CSAE2019), 2019,

← 1 2 3 4 5 →