Interoperability strategies for GASPI and MPI in large-scale scientific applications

被引:0
|
作者
Simmendinger, Christian [1 ]
Iakymchuk, Roman [2 ]
Cebamanos, Luis [5 ]
Akhmetova, Dana [2 ]
Bartsch, Valeria [6 ]
Rotaru, Tiberiu [7 ]
Rahn, Mirko [6 ]
Laure, Erwin [3 ,4 ]
Markidis, Stefano [3 ]
机构
[1] T Syst Solut Res, Stuttgart, Germany
[2] KTH Royal Inst Technol, Lindstedtsvagen 5, S-10044 Stockholm, Sweden
[3] KTH Royal Inst Technol, High Performance Comp, Stockholm, Sweden
[4] KTH Royal Inst Technol, PDC Ctr, High Performance Comp Ctr, Stockholm, Sweden
[5] Univ Edinburgh, EPCC, Edinburgh, Midlothian, Scotland
[6] Fraunhofer ITWM, HPC Dept, Kaiserslautern, Germany
[7] Fraunhofer ITWM, Kaiserslautern, Germany
基金
欧盟地平线“2020”;
关键词
Interoperability; GASPI; MPI; iPIC3D; Ludwig; MiniGhost; halo exchange; Allreduce; PHYSICS; PLASMA;
D O I
10.1177/1094342018808359
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
One of the main hurdles of partitioned global address space (PGAS) approaches is the dominance of message passing interface (MPI), which as a de facto standard appears in the code basis of many applications. To take advantage of the PGAS APIs like global address space programming interface (GASPI) without a major change in the code basis, interoperability between MPI and PGAS approaches needs to be ensured. In this article, we consider an interoperable GASPI/MPI implementation for the communication/performance crucial parts of the Ludwig and iPIC3D applications. To address the discovered performance limitations, we develop a novel strategy for significantly improved performance and interoperability between both APIs by leveraging GASPI shared windows and shared notifications. First results with a corresponding implementation in the MiniGhost proxy application and the Allreduce collective operation demonstrate the viability of this approach.
引用
收藏
页码:554 / 568
页数:15
相关论文
共 50 条
  • [21] Performance analysis of large-scale OpenMP and hybrid MPI/OpenMP applications with Vampir NG
    Brunst, Holger
    Mohr, Bernd
    [J]. OPENMP SHARED MEMORY PARALLEL PROGRAMMING, PROCEEDINGS, 2008, 4315 : 5 - +
  • [22] ACURDION: An Adaptive Clustering-based Algorithm for Tracing Large-scale MPI Applications
    Bahmani, Amir
    Mueller, Frank
    [J]. PROCEEDINGS 2015 IEEE INTERNATIONAL CONFERENCE ON BIG DATA, 2015, : 785 - 792
  • [23] New Applications And Control Strategies For Large-Scale CPV Plants
    Benoit, P.
    Rohbogner, G.
    Fey, S.
    George, D.
    Wuellner, J.
    Rubio, F.
    Gombert, A.
    [J]. 9TH INTERNATIONAL CONFERENCE ON CONCENTRATOR PHOTOVOLTAIC SYSTEMS (CPV-9), 2013, 1556 : 266 - 269
  • [24] Bounding Energy Consumption in Large-Scale MPI Programs
    Rountree, Barry
    Lowenthal, David K.
    Funk, Shelby
    Freeh, Vincent W.
    de Supinski, Bronis R.
    Schulz, Martin
    [J]. 2007 ACM/IEEE SC07 CONFERENCE, 2010, : 54 - +
  • [25] GridMate: A Portable Simulation Environment for Large-Scale Adaptive Scientific Applications
    Li, Xiaolin
    Parashar, Manish
    [J]. CCGRID 2008: EIGHTH IEEE INTERNATIONAL SYMPOSIUM ON CLUSTER COMPUTING AND THE GRID, VOLS 1 AND 2, PROCEEDINGS, 2008, : 82 - +
  • [26] An Efficient Co-processing Framework for Large-scale Scientific Applications
    Duan, Rubing
    Goh, Rick Siow Mong
    Rachmawati, Lily
    Wang, Long
    Palit, Henry N.
    Li, Xiaorong
    Goh, Chi Keong
    Dutta, Partha
    Lapworth, Leigh
    Knott, David
    [J]. 2014 IEEE 6TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING TECHNOLOGY AND SCIENCE (CLOUDCOM), 2014, : 254 - 261
  • [27] Towards Large-Scale Scientific Dataspaces for e-Science Applications
    Elsayed, Ibrahim
    Brezany, Peter
    [J]. DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, 2010, 6193 : 69 - 80
  • [28] Implementation of a Multi-threaded Framework for Large-scale Scientific Applications
    Sexton-Kennedy, E.
    Gartung, Patrick
    Jones, C. D.
    Lange, David
    [J]. 16TH INTERNATIONAL WORKSHOP ON ADVANCED COMPUTING AND ANALYSIS TECHNIQUES IN PHYSICS RESEARCH (ACAT2014), 2015, 608
  • [29] Communication characteristics of large-scale scientific applications for contemporary cluster architectures
    Vetter, JS
    Mueller, F
    [J]. JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2003, 63 (09) : 853 - 865
  • [30] Interoperability in large-scale distributed information delivery systems
    Liu, L
    Yan, LL
    Özsu, MT
    [J]. WORKFLOW MANAGEMENT SYSTEMS AND INTEROPERABILITY, 1998, 164 : 246 - 280