Smart Read/Write for MPI-IO

被引:0
|
作者
Sehrish, Saba [1 ]
Wang, Jun [1 ]
机构
[1] Univ Cent Florida, Sch Elect Engn & Comp Sci, Orlando, FL 32816 USA
关键词
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We present a case for automating the selection of MPI-IO performance optimizations, with an ultimate goal to relieve the application programmer from these details, thereby improving their productivity. Programmers productivity has always been overlooked as compared to the performance optimizations in high performance computing community In this paper we present RFSA, a Reduced Function Set Abstraction based on an existing parallel programming interface (MPI-IO) for I/O. MPI-IO provides high performance I/O function calls to the scientists/engineers writing parallel programs; who are required to use the most appropriate optimization of a specific function, hence limits the programmer productivity Therefore, we propose a set of reduced,functions with an automatic selection algorithm to decide what specific MPI-IO function to use. We implement a selection algorithm for I/O functions like read, write, etc. RFSA replaces 6 different flavors of read and write junctions by one read and write function. By running different parallel I/O benchmarks on both medium-scale clusters and NERSC supercomputers, we show that RFSA functions impose minimal performance penalties.
引用
收藏
页码:1667 / 1674
页数:8
相关论文
共 50 条
  • [31] Transparent log-based data storage in MPI-IO applications
    Kimpe, Dries
    Ross, Rob
    Vandewalle, Stefan
    Poedts, Stefaan
    [J]. RECENT ADVANCES IN PARALLEL VIRTUAL MACHINE AND MESSAGE PASSING INTERFACE, 2007, 4757 : 233 - +
  • [32] On the implementation of a portable, client-server based MPI-IO interface
    Fuerle, T
    Schikuta, E
    Loeffelhardt, C
    Stockinger, K
    Wanek, H
    [J]. RECENT ADVANCES IN PARALLEL VIRTUAL MACHINE AND MESSAGE PASSING INTERFACE, 1998, 1497 : 172 - 179
  • [33] A high performance implementation of MPI-IO for a Lustre file system environment
    Dickens, Phillip M.
    Logan, Jeremy
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2010, 22 (11): : 1433 - 1449
  • [34] Improving generic non-contiguous file access for MPI-IO
    Worringen, J
    Träff, JL
    Ritzdorf, H
    [J]. RECENT ADVANCES IN PARALLEL VIRTUAL MACHINE AND MESSAGE PASSING INTERFACE, 2003, 2840 : 309 - 318
  • [35] An MPI-IO Compliant Java']Java Based Parallel I/O Library
    Awan, Ammar Ahmad
    Amin, Muhammad Bilal
    Hussain, Shujaat
    Shafi, Aamir
    Lee, Sungyoung
    [J]. PROCEEDINGS OF THE 2013 13TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING (CCGRID 2013), 2013, : 174 - +
  • [36] OPAL: An open-source MPI-IO library over Cray XT
    Yu, Weikuan
    Vetter, Jeffrey S.
    Canon, R. Shane
    [J]. SNAPI 2007: FOURTH INTERNATIONAL WORKSHOP ON STORAGE NETWORK ARCHITECTURE AND PARALLEL I/OS, PROCEEDINGS, 2007, : 41 - +
  • [37] A Comparative Study of MPI-IO Libraries for Offloading of Collective I/O Tasks
    Bagbaba, Ayse
    [J]. 2021 7TH INTERNATIONAL CONFERENCE ON ENGINEERING AND EMERGING TECHNOLOGIES (ICEET 2021), 2021, : 712 - 717
  • [38] Enhancing the Performance of MPI-IO Applications by Overlapping I/O, Computation and Communication
    Patrick, Christina M.
    Son, Seung Woo
    Kandemir, Mahmut
    [J]. PPOPP'08: PROCEEDINGS OF THE 2008 ACM SIGPLAN SYMPOSIUM ON PRINCIPLES AND PRACTICE OF PARALLEL PROGRAMMING, 2008, : 277 - 278
  • [39] 面向非易失内存的MPI-IO接口优化
    邓镇龙
    陈志广
    [J]. 大数据, 2021, 7 (02) : 172 - 181
  • [40] Implementing MPI-IO shared file pointers without file system support
    Latham, R
    Ross, R
    Thakur, R
    Toonen, B
    [J]. RECENT ADVANCES IN PARALLEL VIRTUAL MACHINE AND MESSAGE PASSING INTERFACE, PROCEEDINGS, 2005, 3666 : 84 - 93