HPC Software for Massive Analysis of the Parallel Efficiency of Applications

被引:2
|
作者
Shvets, Pavel [1 ]
Voevodin, Vadim [1 ]
Zhumatiy, Sergey [1 ]
机构
[1] Lomonosov Moscow State Univ, Res Comp Ctr, Leninskie Gory 1,Bld 4, Moscow, Russia
基金
俄罗斯科学基金会;
关键词
Supercomputing; Efficiency analysis; Parallel program; Massive analysis; Application performance;
D O I
10.1007/978-3-030-28163-2_1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Efficiency is a major weakness in modern supercomputers. Low efficiency of user applications is one of the main reasons for that. There are many software tools for analyzing and improving the performance of parallel applications. However, supercomputer users often do not have sufficient knowledge and skills to apply these tools correctly in their specific case. Moreover, users often do not know that their applications work inefficiently. The main goal of our project is to help any HPC user to detect performance flaws in their applications and find out how to deal with them. To this end, we plan to develop an open-source software solution that performs automatic massive analysis of all jobs running on a supercomputer to identify those with efficiency issues and helps users to conduct a detailed analysis of an individual program (using existing software tools) to identify and eliminate the root causes of the loss of efficiency.
引用
收藏
页码:3 / 18
页数:16
相关论文
共 50 条
  • [31] Why do Users Need to Take Care of Their HPC Applications Efficiency?
    D. A. Nikitenko
    P. A. Shvets
    V. V. Voevodin
    Lobachevskii Journal of Mathematics, 2020, 41 : 1521 - 1532
  • [32] CAASCADE: A System for Static Analysis of HPC Software Application Portfolios
    Lopez, M. Graham
    Hernandez, Oscar
    Budiardja, Reuben D.
    Wells, Jack C.
    PROGRAMMING AND PERFORMANCE VISUALIZATION TOOLS, 2019, 11027 : 90 - 104
  • [33] Automatic Software Interference Detection in Parallel Applications
    Tabatabaee, Vahid
    Hollingsworth, Jeffrey K.
    2007 ACM/IEEE SC07 CONFERENCE, 2010, : 512 - 523
  • [34] APPLICATIONS, ALGORITHMS, AND SOFTWARE FOR MASSIVELY PARALLEL COMPUTING
    BENNER, RE
    HARRIS, JM
    AT&T TECHNICAL JOURNAL, 1991, 70 (06): : 59 - 72
  • [35] RESEARCH ON PARALLEL BUFFER ANALYSIS WITH GRIDED BASED HPC TECHNOLOGY
    Pang, Lv
    Li, Guoqing
    Yan, Yunxuan
    Ma, Yan
    2009 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, VOLS 1-5, 2009, : 2580 - 2583
  • [37] Analysis and Simulation of Graphs Applied to Learning with Parallel Programming in HPC
    Malagon, Edwin
    Rojas, Alexis
    2017 CHILEAN CONFERENCE ON ELECTRICAL, ELECTRONICS ENGINEERING, INFORMATION AND COMMUNICATION TECHNOLOGIES (CHILECON), 2017,
  • [38] Parallel Performance and I/O Profiling of HPC RNA-Seq Applications
    Cruz, Lucas
    Coelho, Micaella
    Galheigo, Marcelo
    Carneiro, Andre
    Carvalho, Diego
    Gadelha, Luiz
    Boito, Francieli
    Navaux, Philippe
    Osthoff, Carla
    Ocana, Kary
    COMPUTACION Y SISTEMAS, 2022, 26 (04): : 1625 - 1633
  • [39] Towards a HPC-oriented parallel implementation of a learning algorithm for bioinformatics applications
    Gianni D'Angelo
    Salvatore Rampone
    BMC Bioinformatics, 15
  • [40] HPC-MW: A problem solving environment for developing parallel FEM applications
    Ito, Satoshi
    Okuda, Hiroshi
    APPLIED PARALLEL COMPUTING: STATE OF THE ART IN SCIENTIFIC COMPUTING, 2007, 4699 : 694 - +