Modeling pre-Exascale AMR Parallel I/O Workloads via Proxy Applications

被引:0
|
作者
Godoy, William F. [1 ]
Delozier, Jenna [2 ]
Watson, Gregory R. [1 ]
机构
[1] Oak Ridge Natl Lab, Comp Sci & Math Div, Oak Ridge, TN 37830 USA
[2] Georgia Inst Technol, Coll Comp, Atlanta, GA 30332 USA
关键词
Proxy; I/O; AMR; MACSio; HPC; exascale;
D O I
10.1109/IPDPSW55747.2022.00153
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The present work investigates the modeling of pre-exascale input/output (DO) workloads of Adaptive Mesh Refinement (AMR) simulations through a simple proxy application. We collect data from the AMReX Castro framework running on the Summit supercomputer for a wide range of scales and mesh partitions for the hydrodynamic Sedov case as a baseline to provide sufficient coverage to the formulated proxy model. The non-linear analysis data production rates are quantified as a function of a set of input parameters such as output frequency, grid size, number of levels, and the Courant-Friedrichs-Lewy (CFL) condition number for each rank, mesh level and simulation time step. Linear regression is then applied to formulate a simple analytical model which allows to translate AMReX inputs into MACSio proxy I/O application parameters, resulting in a simple "kernel" approximation for data production at each time step. Results show that MACSio can simulate actual AMReX nonlinear "static" I/O workloads to a certain degree of confidence on the Summit supercomputer using the present methodology. The goal is to provide an initial level of understanding of AMR I/O workloads via lightweight proxy applications models to facilitate autotune data management strategies in anticipation of exascale systems.
引用
收藏
页码:952 / 961
页数:10
相关论文
共 50 条
  • [31] Multi-Threaded Parallel I/O for OpenMP Applications
    Mehta, Kshitij
    Gabriel, Edgar
    INTERNATIONAL JOURNAL OF PARALLEL PROGRAMMING, 2015, 43 (02) : 286 - 309
  • [32] Overlay striping and optimal parallel I/O for modern applications
    Triantafillou, P
    Faloutsos, C
    PARALLEL COMPUTING, 1998, 24 (01) : 21 - 43
  • [33] Performance model of I/O-intensive parallel applications
    Chen, Yongran
    Qi, Xingyun
    Dou, Wenhua
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2007, 44 (04): : 707 - 713
  • [34] Modeling for I/O Intensive Applications in Cloud Computing
    Peng Junjie
    Rao Yi
    Dai Yongchuan
    Zhi Xiaofei
    9TH IEEE INTERNATIONAL SYMPOSIUM ON SERVICE-ORIENTED SYSTEM ENGINEERING (SOSE 2015), 2015, : 229 - 234
  • [35] Automated tuning of parallel I/O systems: An approach to portable I/O performance for scientific applications
    Chen, Y
    Winslett, M
    IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2000, 26 (04) : 362 - 383
  • [36] Design and implementation of a parallel I/O runtime system for irregular applications
    No, J
    Park, SS
    Carretero, J
    Choudhary, A
    Chen, P
    FIRST MERGED INTERNATIONAL PARALLEL PROCESSING SYMPOSIUM & SYMPOSIUM ON PARALLEL AND DISTRIBUTED PROCESSING, 1998, : 280 - 284
  • [37] Automatic generation of benchmarks for I/O-intensive parallel applications
    Hao, Meng
    Zhang, Weizhe
    Zhang, You
    Snir, Marc
    Yang, Laurence T.
    JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2019, 124 : 1 - 13
  • [38] Home-based cooperative cache for parallel I/O applications
    Hwang, IC
    Maeng, SR
    Cho, JW
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2006, 22 (05): : 633 - 642
  • [39] Toward a General I/O Layer for Parallel-Visualization Applications
    Kendall, Wesley
    Huang, Jian
    Peterka, Tom
    Latham, Robert
    Ross, Robert
    IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2011, 31 (06) : 6 - 10
  • [40] Run-time library for parallel I/O for irregular applications
    No, J
    Choudhary, A
    PARALLEL COMPUTING: FUNDAMENTALS, APPLICATIONS AND NEW DIRECTIONS, 1998, 12 : 437 - 440