A Visual Analytics Framework for Analyzing Parallel and Distributed Computing Applications

被引:0
|
作者
Li, Jianping Kelvin [1 ]
Fujiwara, Takanori [1 ]
Kesavan, Suraj P. [1 ]
Ross, Caitlin [2 ]
Mubarak, Misbah [3 ]
Carothers, Christopher D. [2 ]
Ross, Robert B. [3 ]
Ma, Kwan-Liu [1 ]
机构
[1] Univ Calif Davis, Davis, CA 95616 USA
[2] Rensselaer Polytech Inst, Troy, NY 12181 USA
[3] Argonne Natl Lab, 9700 S Cass Ave, Argonne, IL 60439 USA
关键词
Visual analytics; information visualization; time-series data; multivariate data; performance analysis; parallel discrete-event simulation; HIGH-PERFORMANCE;
D O I
10.1109/vds48975.2019.8973380
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
To optimize the performance and efficiency of HPC applications, programmers and analysts often need to collect various performance metrics for each computer at different time points as well as the communication data between the computers. This results in a complex dataset that consists of multivariate time-series and communication network data, which makes debugging and performance tuning of I IPC applications challenging. Automated analytical methods based on statistical analysis and unsupervised learning are often insufficient to support such tasks without the background knowledge from the application programmers. To better explore and analyze a wide spectrum of HPC datasets, effective visual data analytics techniques are needed. In this paper, we present a visual analytics framework for analyzing HPC datasets produced by parallel discrete-event simulations (PDES). Our framework leverages automated time-series analysis methods and effective visualizations to analyze both multivariate time-series and communication network data. Through several case studies for analyzing the performance of PDES, we show that our visual analytics techniques and system can be effective in reasoning multiple performance metrics, temporal behaviors of the simulation, and the communication patterns.
引用
收藏
页码:20 / 28
页数:9
相关论文
共 50 条
  • [1] A Software Framework to Support Adaptive Applications in Distributed/Parallel Computing
    Liu, Hao
    Nazir, Amril
    Sorensen, Soren-Aksel
    [J]. HPCC: 2009 11TH IEEE INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS, 2009, : 563 - 570
  • [2] Applications of Distributed and Parallel Computing in the Solvency II Framework: The DISAR System
    Castellani, Gilberto
    Passalacqua, Luca
    [J]. EURO-PAR 2010 PARALLEL PROCESSING WORKSHOPS, 2011, 6586 : 413 - 421
  • [3] DPAC: An object-oriented distributed and parallel computing framework for manufacturing applications
    Raghavan, NRS
    Waghmare, T
    [J]. IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, 2002, 18 (04): : 431 - 443
  • [4] A Visual Analytics Framework for Distributed Data Analysis Systems
    Nayeem, Abdullah-Al-Raihan
    Elshambakey, Mohammed
    Dobbs, Todd
    Lee, Huikyo
    Crichton, Daniel
    Zhu, Yimin
    Chokwitthaya, Chanachok
    Tolone, William J.
    Cho, Isaac
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2021, : 229 - 240
  • [5] A Visual Analytics Framework for the Detection of Anomalous Call Stack Trees in High Performance Computing Applications
    Xie, Cong
    Xu, Wei
    Mueller, Klaus
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2019, 25 (01) : 215 - 224
  • [6] SunwayMR: A distributed parallel computing framework with convenient data-intensive applications programming
    Wu, Renke
    Huang, Linpeng
    Yu, Peng
    Zhou, Haojie
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2017, 71 : 43 - 56
  • [7] Parallel and distributed computing for Big Data applications
    Senger, Hermes
    Geyer, Claudio
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2016, 28 (08): : 2412 - 2415
  • [8] Guest Editorial - Parallel and Distributed Computing and Applications
    Shen, Hong
    Tian, Hui
    Sang, Yingpeng
    [J]. COMPUTER SCIENCE AND INFORMATION SYSTEMS, 2023, 20 (01) : IX - X
  • [9] Advances in parallel and distributed computing and its applications
    Tian, Hui
    Liew, Alan Wee-Chung
    Shen, Hong
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2022, 34 (02):
  • [10] Application of distributed parallel computing for dynamic visual cryptography
    Raimondas Čiegis
    Vadimas Starikovičius
    Natalija Tumanova
    Minvydas Ragulskis
    [J]. The Journal of Supercomputing, 2016, 72 : 4204 - 4220