Smart Read/Write for MPI-IO

被引:0
|
作者
Sehrish, Saba [1 ]
Wang, Jun [1 ]
机构
[1] Univ Cent Florida, Sch Elect Engn & Comp Sci, Orlando, FL 32816 USA
关键词
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We present a case for automating the selection of MPI-IO performance optimizations, with an ultimate goal to relieve the application programmer from these details, thereby improving their productivity. Programmers productivity has always been overlooked as compared to the performance optimizations in high performance computing community In this paper we present RFSA, a Reduced Function Set Abstraction based on an existing parallel programming interface (MPI-IO) for I/O. MPI-IO provides high performance I/O function calls to the scientists/engineers writing parallel programs; who are required to use the most appropriate optimization of a specific function, hence limits the programmer productivity Therefore, we propose a set of reduced,functions with an automatic selection algorithm to decide what specific MPI-IO function to use. We implement a selection algorithm for I/O functions like read, write, etc. RFSA replaces 6 different flavors of read and write junctions by one read and write function. By running different parallel I/O benchmarks on both medium-scale clusters and NERSC supercomputers, we show that RFSA functions impose minimal performance penalties.
引用
收藏
页码:1667 / 1674
页数:8
相关论文
共 50 条
  • [1] Optimizing noncontiguous accesses in MPI-IO
    Thakur, R
    Gropp, W
    Lusk, E
    [J]. PARALLEL COMPUTING, 2002, 28 (01) : 83 - 105
  • [2] PMPIO - A portable implementation of MPI-IO
    Fineberg, SA
    Wong, P
    Nitzberg, B
    Kuszmaul, C
    [J]. FRONTIERS '96 - THE SIXTH SYMPOSIUM ON FRONTIERS OF MASSIVELY PARALLEL COMPUTING, PROCEEDINGS, 1996, : 188 - 195
  • [3] IMPLEMENTATION AND EVALUATION OF FILE WRITE-BACK AND PREFETCHING FOR MPI-IO OVER GPFS
    Garcia Blas, Javier
    Isaila, Florin
    Carretero, Jesus
    Singh, David
    Garcia-Carballeira, Felix
    [J]. INTERNATIONAL JOURNAL OF HIGH PERFORMANCE COMPUTING APPLICATIONS, 2010, 24 (01): : 78 - 92
  • [4] Design of Locality-aware MPI-IO for Scalable Shared File Write Performance
    Sugihara, Kohei
    Tatebe, Osamu
    [J]. 2020 IEEE 34TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW 2020), 2020, : 1080 - 1089
  • [5] The impact of file systems on MPI-IO scalability
    Latham, R
    Ross, R
    Thakur, R
    [J]. RECENT ADVANCES IN PARALLEL VIRTUAL MACHINE AND MESSAGE PASSING INTERFACE, PROCEEDINGS, 2004, 3241 : 87 - 96
  • [6] On implementing MPI-IO portably and with high performance
    Thakur, Rajeev
    Gropp, William
    Lusk, Ewing
    [J]. Proceedings of the Annual Workshop on I/O in Parallel and Distributed Systems, IOPADS, 1999, : 23 - 32
  • [7] Scalable approaches for supporting MPI-IO atomicity
    Aarestad, Peter M.
    Ching, Avery
    Thiruvathukal, George K.
    Choudhary, Alok N.
    [J]. SIXTH IEEE INTERNATIONAL SYMPOSIUM ON CLUSTER COMPUTING AND THE GRID: SPANNING THE WORLD AND BEYOND, 2006, : 35 - +
  • [8] Tracing the MPI-IO calls' disk accesses
    Ludwig, Thomas
    Krempel, Stephan
    Kunkel, Julian
    Panse, Frank
    Withanage, Dulip
    [J]. RECENT ADVANCES IN PARALLEL VIRTUAL MACHINE AND MESSAGE PASSING INTERFACE, 2006, 4192 : 322 - 330
  • [9] Automatic MPI-IO Tuning with the Periscope Tuning Framework
    Liu, Weifeng
    Urena, Isaias A. Compres
    Gerndt, Michael
    Gong, Bin
    [J]. PROCEEDINGS OF 2014 IEEE INTERNATIONAL PARALLEL & DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW), 2014, : 352 - 360
  • [10] Noncontiguous I/O accesses through MPI-IO
    Ching, A
    Choudhary, A
    Coloma, K
    Liao, WK
    Ross, R
    Gropp, W
    [J]. CCGRID 2003: 3RD IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER COMPUTING AND THE GRID, PROCEEDINGS, 2003, : 104 - 111