A High-Level Tool for Enhancing the Performance and Scalability of Open-Source Relational Databases

被引:1
|
作者
Sukhija, Nitin [1 ]
Miller, Zachariah [1 ]
Arora, Ritu [2 ]
机构
[1] Slippery Rock Univ Penn, Slippery Rock, PA 16057 USA
[2] Texas Adv Comp Ctr, Ausin, TX USA
关键词
Big Data; Performance; Partitioning; MYSQL; Relational Databases; Large Scale Datasets;
D O I
10.1145/3167020.3167031
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this paper, we present a high-level tool for partitioning open-source relational databases, thereby, enhancing their performance and scalability. The tool is implemented using Java and SQL, and has been tested on both MySQL and PostgreSQL databases. Our tool can be used through an interactive interface (both command-line interface and web-interface are supported) and can help in automatically partitioning a given database using hash, key or range partitioning schemes. We evaluated the performance of the Select and Join queries before and after partitioning two real-world datasets - the U. S Department of Agriculture (USDA) food products database, and the Sloan Digital Sky Survey (SDSS) database. The results of this evaluation are presented in this paper. We also discuss the difference in performance of the queries before and after partitioning, and show the impact of the selection of different partitioning schemes - hash, key, range - on the performance of the queries. In some cases, a significant increase in query performance - up to 57% - is observed by partitioning the database tables appropriately.
引用
收藏
页码:73 / 80
页数:8
相关论文
共 50 条
  • [1] A high-level tool for enhancing the performance and scalability of open-source relational databases
    Sukhija, Nitin
    Miller, Zachariah
    Arora, Ritu
    [J]. 9th International Conference on Management of Digital EcoSystems, MEDES 2017, 2017, 2017-January : 73 - 80
  • [2] Evaluation of High-Level Open-Source Tool-Flows for Rapid Prototyping of Software Defined Radios
    Setetemela, Khobatha
    Winberg, Simon
    Inggs, Michael
    [J]. 2015 IEEE RADIO AND ANTENNA DAYS OF THE INDIAN OCEAN (RADIO), 2015,
  • [3] LegUp: An Open-Source High-Level Synthesis Tool for FPGA-Based Processor/Accelerator Systems
    Canis, Andrew
    Choi, Jongsok
    Aldham, Mark
    Zhang, Victor
    Kammoona, Ahmed
    Czajkowski, Tomasz
    Brown, Stephen D.
    Anderson, Jason H.
    [J]. ACM TRANSACTIONS ON EMBEDDED COMPUTING SYSTEMS, 2013, 13 (02)
  • [4] High-Level Interaction with Relational Databases in Logic Programming
    Porto, Antonio
    [J]. PRACTICAL ASPECTS OF DECLARATIVE LANGUAGES, 2009, 5418 : 152 - 167
  • [5] Growing up with stability: How open-source relational databases evolve
    Skoulis, Ioannis
    Vassiliadis, Panos
    Zarras, Apostolos V.
    [J]. INFORMATION SYSTEMS, 2015, 53 : 363 - 385
  • [6] An Open-Source High-Level Fusion Algorithm in ROS for Automated Driving Applications
    Poledna, Yuri
    Reway, Fabio
    Drechsler, Maikol Funk
    Huber, Werner
    Icking, Christian
    Ribeiro, Eduardo Parente
    [J]. 2022 10TH INTERNATIONAL CONFERENCE IN SOFTWARE ENGINEERING RESEARCH AND INNOVATION, CONISOFT, 2022, : 174 - 181
  • [7] An open-source, high-performance tool for automated sleep staging
    Vallat, Raphael
    Walker, Matthew P.
    [J]. ELIFE, 2021, 10
  • [8] An open-source tool for merging data from multiple citation databases
    Nikolic, Dusan
    Ivanovic, Dragan
    Ivanovic, Lidija
    [J]. SCIENTOMETRICS, 2024, 129 (07) : 4573 - 4595
  • [9] Invited: Bambu: an Open-Source Research Framework for the High-Level Synthesis of Complex Applications
    Ferrandi, Fabrizio
    Castellana, Vito Giovanni
    Curzel, Serena
    Fezzardi, Pietro
    Fiorito, Michele
    Lattuada, Marco
    Minutoli, Marco
    Pilato, Christian
    Tumeo, Antonino
    [J]. 2021 58TH ACM/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2021, : 1327 - 1330
  • [10] Open-Source OPC UA Security and Scalability
    Muehlbauer, Nikolas
    Kirdan, Erkin
    Pahl, Marc-Oliver
    Carle, Georg
    [J]. 2020 25TH IEEE INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2020, : 262 - 269