Smart Read/Write for MPI-IO

被引:0
|
作者
Sehrish, Saba [1 ]
Wang, Jun [1 ]
机构
[1] Univ Cent Florida, Sch Elect Engn & Comp Sci, Orlando, FL 32816 USA
关键词
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We present a case for automating the selection of MPI-IO performance optimizations, with an ultimate goal to relieve the application programmer from these details, thereby improving their productivity. Programmers productivity has always been overlooked as compared to the performance optimizations in high performance computing community In this paper we present RFSA, a Reduced Function Set Abstraction based on an existing parallel programming interface (MPI-IO) for I/O. MPI-IO provides high performance I/O function calls to the scientists/engineers writing parallel programs; who are required to use the most appropriate optimization of a specific function, hence limits the programmer productivity Therefore, we propose a set of reduced,functions with an automatic selection algorithm to decide what specific MPI-IO function to use. We implement a selection algorithm for I/O functions like read, write, etc. RFSA replaces 6 different flavors of read and write junctions by one read and write function. By running different parallel I/O benchmarks on both medium-scale clusters and NERSC supercomputers, we show that RFSA functions impose minimal performance penalties.
引用
收藏
页码:1667 / 1674
页数:8
相关论文
共 50 条
  • [21] An efficient MPI-IO for noncontiguous data access over InfiniBand
    Hong, DY
    You, CW
    Chung, YC
    [J]. 8th International Symposium on Parallel Architectures, Algorithms and Networks, Proceedings, 2005, : 140 - 145
  • [22] RFS: Efficient and flexible remote file access for MPI-IO
    Lee, J
    Ma, XS
    Ross, R
    Thakur, R
    Winslett, M
    [J]. 2004 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING, 2004, : 71 - 81
  • [23] Conflict Detection Algorithm to Minimize Locking for MPI-IO Atomicity
    Sehrish, Saba
    Wang, Jun
    Thakur, Rajeev
    [J]. RECENT ADVANCES IN PARALLEL VIRTUAL MACHINE AND MESSAGE PASSING INTERFACE, PROCEEDINGS, 2009, 5759 : 143 - +
  • [24] Implementing MPI-IO atomic mode without file system support
    Ross, R
    Latham, R
    Gropp, W
    Thakur, R
    Toonen, B
    [J]. 2005 IEEE INTERNATIONAL SYMPOSIUM ON CLUSTER COMPUTING AND THE GRID, VOLS 1 AND 2, 2005, : 1135 - 1142
  • [25] Towards a High Performance Implementation of MPI-IO on the Lustre File System
    Dickens, Phillip
    Logan, Jeremy
    [J]. ON THE MOVE TO MEANINGFUL INTERNET SYSTEMS: OTM 2008, PART I, 2008, 5331 : 870 - 885
  • [26] Towards a high-performance implementation of MPI-IO on top of GPFS
    Prost, JP
    Treumann, R
    Hedges, R
    Koniges, A
    White, A
    [J]. EURO-PAR 2000 PARALLEL PROCESSING, PROCEEDINGS, 2000, 1900 : 1253 - 1262
  • [27] Exploiting Efficient Transpacking for One-Sided Communication and MPI-IO
    Mir, Faisal Ghias
    Traeff, Jesper Larsson
    [J]. RECENT ADVANCES IN PARALLEL VIRTUAL MACHINE AND MESSAGE PASSING INTERFACE, PROCEEDINGS, 2009, 5759 : 154 - 163
  • [28] Fault tolerant file models for MPI-IO parallel file systems
    Calderon, A.
    Garcia-Carballeira, F.
    Isaila, Florin
    Keller, Rainer
    Schulz, Alexander
    [J]. RECENT ADVANCES IN PARALLEL VIRTUAL MACHINE AND MESSAGE PASSING INTERFACE, 2007, 4757 : 153 - +
  • [29] Integrating logical and physical file models in the MPI-IO implementation for "Clusterfile"
    Isaila, Florin
    Singh, David
    Carretero, Jesus
    Garcia, Felix
    Szeder, Gabor
    Moschny, Thomas
    [J]. SIXTH IEEE INTERNATIONAL SYMPOSIUM ON CLUSTER COMPUTING AND THE GRID: SPANNING THE WORLD AND BEYOND, 2006, : 462 - +
  • [30] Model-based MPI-IO tuning with Periscope tuning framework
    Liu, Weifeng
    Gerndt, Michael
    Gong, Bin
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2016, 28 (01): : 3 - 20