Modeling pre-Exascale AMR Parallel I/O Workloads via Proxy Applications

被引:0
|
作者
Godoy, William F. [1 ]
Delozier, Jenna [2 ]
Watson, Gregory R. [1 ]
机构
[1] Oak Ridge Natl Lab, Comp Sci & Math Div, Oak Ridge, TN 37830 USA
[2] Georgia Inst Technol, Coll Comp, Atlanta, GA 30332 USA
关键词
Proxy; I/O; AMR; MACSio; HPC; exascale;
D O I
10.1109/IPDPSW55747.2022.00153
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The present work investigates the modeling of pre-exascale input/output (DO) workloads of Adaptive Mesh Refinement (AMR) simulations through a simple proxy application. We collect data from the AMReX Castro framework running on the Summit supercomputer for a wide range of scales and mesh partitions for the hydrodynamic Sedov case as a baseline to provide sufficient coverage to the formulated proxy model. The non-linear analysis data production rates are quantified as a function of a set of input parameters such as output frequency, grid size, number of levels, and the Courant-Friedrichs-Lewy (CFL) condition number for each rank, mesh level and simulation time step. Linear regression is then applied to formulate a simple analytical model which allows to translate AMReX inputs into MACSio proxy I/O application parameters, resulting in a simple "kernel" approximation for data production at each time step. Results show that MACSio can simulate actual AMReX nonlinear "static" I/O workloads to a certain degree of confidence on the Summit supercomputer using the present methodology. The goal is to provide an initial level of understanding of AMR I/O workloads via lightweight proxy applications models to facilitate autotune data management strategies in anticipation of exascale systems.
引用
收藏
页码:952 / 961
页数:10
相关论文
共 50 条
  • [21] Automatic Cloud I/O Configurator for I/O Intensive Parallel Applications
    Zhai, Jidong
    Liu, Mingliang
    Jin, Ye
    Ma, Xiaosong
    Chen, Wenguang
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2015, 26 (12) : 3275 - 3288
  • [22] Improving the performance of cluster applications through I/O proxy architecture
    Sanchez, Luis Miguel
    Isaila, F.
    2006 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING, VOLS 1 AND 2, 2006, : 567 - +
  • [23] An energy-oriented evaluation of buffer cache algorithms using parallel I/O workloads
    Yue, Jianhui
    Zhu, Yifeng
    Cai, Zhao
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2008, 19 (11) : 1565 - 1578
  • [24] I/O optimization in the checkpointing of OpenMP parallel applications
    Losada, Nuria
    Martin, Maria J.
    Rodriguez, Gabriel
    Gonzalez, Patricia
    23RD EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED, AND NETWORK-BASED PROCESSING (PDP 2015), 2015, : 222 - 229
  • [25] Analyzing the Parallel I/O Severity of MPI Applications
    Mendez, Sandra
    Rexachs, Dolores
    Luque, Emilio
    2017 17TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING (CCGRID), 2017, : 953 - 962
  • [26] A parallel I/O behavior model for HPC applications using serial I/O libraries
    Gomez-Sanchez, Pilar
    Mendez, Sandra
    Rexachs, Dolores
    Luque, Emilio
    2017 INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING & SIMULATION (HPCS), 2017, : 244 - 251
  • [27] Models of parallel applications with large computation and I/O requirements
    Rosti, E
    Serazzi, G
    Smirni, E
    Squillante, MS
    IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2002, 28 (03) : 286 - 307
  • [28] Characterization and Modeling of PIDX Parallel I/O for Performance Optimization
    Kumar, Sidharth
    Saha, Avishek
    Vishwanath, Venkatram
    Carns, Philip
    Schmidt, John A.
    Scorzelli, Giorgio
    Kolla, Hemanth
    Grout, Ray
    Latham, Robert
    Ross, Robert
    Papka, Michael E.
    Chen, Jacqueline
    Pascucci, Valerio
    2013 INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS (SC), 2013,
  • [29] Multi-Threaded Parallel I/O for OpenMP Applications
    Kshitij Mehta
    Edgar Gabriel
    International Journal of Parallel Programming, 2015, 43 : 286 - 309
  • [30] User-controllable parallel I/O for scientific applications
    Lee, JS
    Song, Y
    1998 INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS, PROCEEDINGS, 1998, : 792 - 799