Interoperability strategies for GASPI and MPI in large-scale scientific applications

被引:0
|
作者
Simmendinger, Christian [1 ]
Iakymchuk, Roman [2 ]
Cebamanos, Luis [5 ]
Akhmetova, Dana [2 ]
Bartsch, Valeria [6 ]
Rotaru, Tiberiu [7 ]
Rahn, Mirko [6 ]
Laure, Erwin [3 ,4 ]
Markidis, Stefano [3 ]
机构
[1] T Syst Solut Res, Stuttgart, Germany
[2] KTH Royal Inst Technol, Lindstedtsvagen 5, S-10044 Stockholm, Sweden
[3] KTH Royal Inst Technol, High Performance Comp, Stockholm, Sweden
[4] KTH Royal Inst Technol, PDC Ctr, High Performance Comp Ctr, Stockholm, Sweden
[5] Univ Edinburgh, EPCC, Edinburgh, Midlothian, Scotland
[6] Fraunhofer ITWM, HPC Dept, Kaiserslautern, Germany
[7] Fraunhofer ITWM, Kaiserslautern, Germany
基金
欧盟地平线“2020”;
关键词
Interoperability; GASPI; MPI; iPIC3D; Ludwig; MiniGhost; halo exchange; Allreduce; PHYSICS; PLASMA;
D O I
10.1177/1094342018808359
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
One of the main hurdles of partitioned global address space (PGAS) approaches is the dominance of message passing interface (MPI), which as a de facto standard appears in the code basis of many applications. To take advantage of the PGAS APIs like global address space programming interface (GASPI) without a major change in the code basis, interoperability between MPI and PGAS approaches needs to be ensured. In this article, we consider an interoperable GASPI/MPI implementation for the communication/performance crucial parts of the Ludwig and iPIC3D applications. To address the discovered performance limitations, we develop a novel strategy for significantly improved performance and interoperability between both APIs by leveraging GASPI shared windows and shared notifications. First results with a corresponding implementation in the MiniGhost proxy application and the Allreduce collective operation demonstrate the viability of this approach.
引用
收藏
页码:554 / 568
页数:15
相关论文
共 50 条
  • [1] Interoperability of GASPI and MPI in Large Scale Scientific Applications
    Akhmetova, Dana
    Cebamanos, Luis
    Iakymchuk, Roman
    Rotaru, Tiberiu
    Rahn, Mirko
    Markidis, Stefano
    Laure, Erwin
    Bartsch, Valeria
    Simmendinger, Christian
    [J]. PARALLEL PROCESSING AND APPLIED MATHEMATICS (PPAM 2017), PT II, 2018, 10778 : 277 - 287
  • [2] Enhancing fault-tolerance of large-scale MPI scientific applications
    Rodriguez, G.
    Gonzalez, P.
    Martin, M. J.
    Tourino, J.
    [J]. PARALLEL COMPUTING TECHNOLOGIES, PROCEEDINGS, 2007, 4671 : 153 - 161
  • [3] Performance modeling of hybrid MPI/OpenMP scientific applications on large-scale multicore supercomputers
    Wu, Xingfu
    Taylor, Valerie
    [J]. JOURNAL OF COMPUTER AND SYSTEM SCIENCES, 2013, 79 (08) : 1256 - 1268
  • [4] Using MPI File Caching to Improve Parallel Write Performance for Large-Scale Scientific Applications
    Liao, Wei-keng
    Ching, Avery
    Coloma, Kenin
    Nisar, Arifa
    Choudhary, Alok
    Chen, Jacqueline
    Sankaran, Ramanan
    Klasky, Scott
    [J]. 2007 ACM/IEEE SC07 CONFERENCE, 2010, : 661 - +
  • [5] Performance characteristics of hybrid MPI/OpenMP scientific applications on a large-scale multithreaded BlueGene/Q supercomputer
    Wu X.
    Taylor V.
    [J]. International Journal of Networked and Distributed Computing, 2013, 1 (4) : 213 - 225
  • [6] Performance Characteristics of Hybrid MPI/OpenMP Scientific Applications on a Large-scale Multithreaded BlueGene/Q Supercomputer
    Wu, Xingfu
    Taylor, Valerie
    [J]. 2013 14TH ACIS INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, ARTIFICIAL INTELLIGENCE, NETWORKING AND PARALLEL/DISTRIBUTED COMPUTING (SNPD 2013), 2013, : 303 - 309
  • [7] Performance Characteristics of Hybrid MPI/OpenMP Scientific Applications on a Large-scale Multithreaded BlueGene/Q Supercomputer
    Wu, Xingfu
    Taylor, Valerie
    [J]. INTERNATIONAL JOURNAL OF NETWORKED AND DISTRIBUTED COMPUTING, 2013, 1 (04) : 213 - 225
  • [8] A methodology for scientific benchmarking with large-scale applications
    Armstrong, B
    Eigenmann, R
    [J]. PERFORMANCE EVALUATION AND BENCHMARKING WITH REALISTIC APPLICATIONS, 2001, : 109 - 127
  • [9] Software testing and evaluation in large-scale scientific applications
    Mu, M
    [J]. QUALITY OF NUMERICAL SOFTWARE - ASSESSMENT AND ENHANCEMENT, 1997, : 330 - 332
  • [10] Energy Modeling of Supercomputers and Large-Scale Scientific Applications
    Pakin, Scott
    Lang, Michael
    [J]. 2013 INTERNATIONAL GREEN COMPUTING CONFERENCE (IGCC), 2013,