HPC Software for Massive Analysis of the Parallel Efficiency of Applications

被引:2
|
作者
Shvets, Pavel [1 ]
Voevodin, Vadim [1 ]
Zhumatiy, Sergey [1 ]
机构
[1] Lomonosov Moscow State Univ, Res Comp Ctr, Leninskie Gory 1,Bld 4, Moscow, Russia
基金
俄罗斯科学基金会;
关键词
Supercomputing; Efficiency analysis; Parallel program; Massive analysis; Application performance;
D O I
10.1007/978-3-030-28163-2_1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Efficiency is a major weakness in modern supercomputers. Low efficiency of user applications is one of the main reasons for that. There are many software tools for analyzing and improving the performance of parallel applications. However, supercomputer users often do not have sufficient knowledge and skills to apply these tools correctly in their specific case. Moreover, users often do not know that their applications work inefficiently. The main goal of our project is to help any HPC user to detect performance flaws in their applications and find out how to deal with them. To this end, we plan to develop an open-source software solution that performs automatic massive analysis of all jobs running on a supercomputer to identify those with efficiency issues and helps users to conduct a detailed analysis of an individual program (using existing software tools) to identify and eliminate the root causes of the loss of efficiency.
引用
收藏
页码:3 / 18
页数:16
相关论文
共 50 条
  • [1] A software architecture for HPC grid applications
    Newhouse, S
    Mayer, A
    Darlington, J
    EURO-PAR 2000 PARALLEL PROCESSING, PROCEEDINGS, 2000, 1900 : 686 - 689
  • [2] An interactive engineering tool for parallel HPC applications
    Lenke, M
    ADVANCES IN ENGINEERING SOFTWARE, 1996, 26 (02) : 121 - 131
  • [3] Verification and Validation in CREATE Multiphysics HPC Software Applications
    Kendall, Richard P.
    Votta, Lawrence G.
    Post, Douglass E.
    Moyer, E. Thomas
    Morton, Scott A.
    COMPUTING IN SCIENCE & ENGINEERING, 2017, 19 (06) : 18 - 26
  • [4] HPC Software and Programming Environments for Big Data Applications
    Kim, Youngjae
    Park, Sungyong
    Wang, Feiyi
    Sun, Guangyu
    Wang, Shangguang
    SCIENTIFIC PROGRAMMING, 2018, 2018
  • [5] Energy-agile design for parallel HPC applications
    Wang, Cong
    Zink, Michael
    Irwin, David
    SUSTAINABLE COMPUTING-INFORMATICS & SYSTEMS, 2018, 19 : 123 - 134
  • [6] Parallel encryption of input and output data for HPC applications
    Lapworth, Leigh
    INTERNATIONAL JOURNAL OF HIGH PERFORMANCE COMPUTING APPLICATIONS, 2022, 36 (02): : 231 - 250
  • [7] Optimizing Parallel HPC Applications for Green Energy Sources
    Wang, Cong
    Zink, Michael
    Irwin, David
    2015 SIXTH INTERNATIONAL GREEN COMPUTING CONFERENCE AND SUSTAINABLE COMPUTING CONFERENCE (IGSC), 2015,
  • [8] DaStGen - A data structure generator for parallel C++ HPC software
    Bungartz, Hans-Joachim
    Eckhardt, Wolfgang
    Mehl, Miriam
    Weinzier, Tobias
    COMPUTATIONAL SCIENCE - ICCS 2008, PT 3, 2008, 5103 : 213 - 222
  • [9] Performance and energy efficiency analysis of HPC physics simulation applications in a cluster of ARM processors
    Bez, Jean Luca
    Bernart, Eliezer E.
    dos Santos, Fernando F.
    Schnorr, Lucas Mello
    Alexandre Navaux, Philippe Olivier
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2017, 29 (22):
  • [10] On the portability and efficiency of parallel algorithms and software
    tenCate, HH
    Vollebregt, EAH
    PARALLEL COMPUTING, 1996, 22 (08) : 1149 - 1163