Debugging Big Data Analytics in Spark with BigDebug

被引：7
|
作者：
Gulzar, Muhammad Ali [1 ]
Interlandi, Matteo [1 ]
Condie, Tyson [1 ]
Kim, Miryung [1 ]
机构：
[1] Univ Calif Los Angeles, Los Angeles, CA 90095 USA
来源：
SIGMOD'17: PROCEEDINGS OF THE 2017 ACM INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA | 2017年
关键词：
D O I：
10.1145/3035918.3058737
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
To process massive quantities of data, developers leverage Data-Intensive Scalable Computing (DISC) systems such as Apache Spark. In terms of debugging, DISC systems support only postmortem log analysis and do not provide any debugging functionality. This demonstration paper showcases BIGDEBUG: a tool enhancing Apache Spark with a set of interactive debugging features that can help users in debug their Big Data Applications.
引用
收藏
页码：1627 / 1630
页数：4
相关论文
共 50 条
  • [1] BigDebug: Debugging Primitives for Interactive Big Data Processing in Spark
    Gulzar, Muhammad Ali
    Interlandi, Matteo
    Yoo, Seunghyun
    Tetali, Sai Deep
    Condie, Tyson
    Millstein, Todd
    Kim, Miryung
    2016 IEEE/ACM 38TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE), 2016, : 784 - 795
  • [2] BigDebug: Interactive Debugger for Big Data Analytics in Apache Spark
    Gulzar, Muhammad Ali
    Interlandi, Matteo
    Condie, Tyson
    Kim, Miryung
    FSE'16: PROCEEDINGS OF THE 2016 24TH ACM SIGSOFT INTERNATIONAL SYMPOSIUM ON FOUNDATIONS OF SOFTWARE ENGINEERING, 2016, : 1033 - 1037
  • [3] Interactive and Automated Debugging for Big Data Analytics
    Gulzar, Muhammad Ali
    PROCEEDINGS 2018 IEEE/ACM 40TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING - COMPANION (ICSE-COMPANION, 2018, : 509 - 511
  • [4] Big data analytics on Apache Spark
    Salloum S.
    Dautov R.
    Chen X.
    Peng P.X.
    Huang J.Z.
    International Journal of Data Science and Analytics, 2016, 1 (3-4) : 145 - 164
  • [5] Geospatial Big Data Analytics Engine for Spark
    Wang, Shaohua
    Zhong, Yang
    Lu, Hao
    Wang, Erqi
    Yun, Weiying
    Cai, Wenwen
    BIGSPATIAL 2017: PROCEEDINGS OF THE 6TH ACM SIGSPATIAL INTERNATIONAL WORKSHOP ON ANALYTICS FOR BIG GEOSPATIAL DATA (BIGSPATIAL-2017), 2017, : 42 - 45
  • [6] Big Data Analytics with Datalog Queries on Spark
    Shkapsky, Alexander
    Yang, Mohan
    Interlandi, Matteo
    Chiu, Hsuan
    Condie, Tyson
    Zaniolo, Carlo
    SIGMOD'16: PROCEEDINGS OF THE 2016 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2016, : 1135 - 1149
  • [7] Big Data Software Analytics with Apache Spark
    Gousios, Georgios
    PROCEEDINGS 2018 IEEE/ACM 40TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING - COMPANION (ICSE-COMPANION, 2018, : 542 - 543
  • [8] Evolution of Spark Framework for simplifying Big Data Analytics
    Kumar, Subhash
    PROCEEDINGS OF THE 10TH INDIACOM - 2016 3RD INTERNATIONAL CONFERENCE ON COMPUTING FOR SUSTAINABLE GLOBAL DEVELOPMENT, 2016, : 3597 - 3602
  • [9] BigSift: Automated Debugging of Big Data Analytics in Data-Intensive Scalable Computing
    Gulzar, Muhammad Ali
    Wang, Siman
    Kim, Miryung
    ESEC/FSE'18: PROCEEDINGS OF THE 2018 26TH ACM JOINT MEETING ON EUROPEAN SOFTWARE ENGINEERING CONFERENCE AND SYMPOSIUM ON THE FOUNDATIONS OF SOFTWARE ENGINEERING, 2018, : 863 - 866
  • [10] Big Data Analytics for the ATLAS EventIndex Project with Apache Spark
    Casani, Alvaro Fernandez
    Montoro, Carlos Garcia
    de la Hoz, Santiago Gonzalez
    Salt, Jose
    Sanchez, Javier
    Perez, Miguel Villaplana
    COMPUTATIONAL AND MATHEMATICAL METHODS, 2023, 2023
12345