Automatic Partitioning of Database Applications

被引:25
|
作者
Cheung, Alvin [1 ]
Madden, Samuel [1 ]
Arden, Owen [2 ]
Myers, Andrew C. [2 ]
机构
[1] MIT, CSAIL, Cambridge, MA 02139 USA
[2] Cornell Univ, Dept Comp Sci, Ithaca, NY 14853 USA
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2012年 / 5卷 / 11期
基金
美国国家科学基金会;
关键词
D O I
10.14778/2350229.2350262
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Database-backed applications are nearly ubiquitous in our daily lives. Applications that make many small accesses to the database create two challenges for developers: increased latency and wasted resources from numerous network round trips. A well-known technique to improve transactional database application performance is to convert part of the application into stored procedures that are executed on the database server. Unfortunately, this conversion is often difficult. In this paper we describe Pyxis, a system that takes database-backed applications and automatically partitions their code into two pieces, one of which is executed on the application server and the other on the database server. Pyxis profiles the application and server loads, statically analyzes the code's dependencies, and produces a partitioning that minimizes the number of control transfers as well as the amount of data sent during each transfer. Our experiments using TPC-C and TPC-W show that Pyxis is able to generate partitions with up to 3x reduction in latency and 1.7x improvement in throughput when compared to a traditional non-partitioned implementation and has comparable performance to that of a custom stored procedure implementation.
引用
收藏
页码:1471 / 1482
页数:12
相关论文
共 50 条
  • [41] Approximate hypergraph partitioning and applications
    Fischer, Eldar
    Matsliah, Arie
    Shapira, Asaf
    48TH ANNUAL IEEE SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE, PROCEEDINGS, 2007, : 579 - +
  • [42] Automatic partitioning of web pages using clustering
    Romero, R
    Berger, A
    MOBILE HUMAN-COMPUTER INTERACTION - MOBILEHCI 2004, PROCEEDINGS, 2004, 3160 : 388 - 393
  • [43] Automatic Partitioning of Stencil Computations on Heterogeneous Systems
    Pereira, Alyson D.
    Rocha, Rodrigo C. O.
    Ramos, Luiz
    Castro, Marcio
    Goes, Luis F. W.
    2017 INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE AND HIGH PERFORMANCE COMPUTING WORKSHOPS (SBAC-PADW), 2017, : 43 - 48
  • [44] Privman: A library for partitioning applications
    Kilpatrick, D
    USENIX ASSOCIATION PROCEEDINGS OF THE FREENIX TRACK, 2003, : 273 - 284
  • [45] APPROXIMATE HYPERGRAPH PARTITIONING AND APPLICATIONS
    Fischer, Eldar
    Matsliah, Arie
    Shapira, Asaf
    SIAM JOURNAL ON COMPUTING, 2010, 39 (07) : 3155 - 3185
  • [46] Automatic actor-based program partitioning
    Bushehrian, Omid
    JOURNAL OF ZHEJIANG UNIVERSITY-SCIENCE C-COMPUTERS & ELECTRONICS, 2010, 11 (01): : 45 - 55
  • [47] Automatic actor-based program partitioning
    Omid Bushehrian
    Journal of Zhejiang University SCIENCE C, 2010, 11 : 45 - 55
  • [48] Invariant structures of partitioning with applications
    Dzyubko, S.I.
    Avtomatika i Telemekhanika, 2002, (03): : 129 - 133
  • [50] AVPS: Automatic Vertical Partitioning for Dynamic Workload
    Liu, Pengju
    Cai, Pan
    Li, Cuiping
    Chen, Hong
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT XIII, ICIC 2024, 2024, 14874 : 146 - 157