Using file system counters in modelling parallel I/O architectures

被引:0
|
作者
El Sayed, Salem [1 ]
Bolten, Matthias [2 ]
Pleiter, Dirk [1 ]
机构
[1] Forschungszentrum Julich, Julich Supercomp Ctr, D-52425 Julich, Germany
[2] Univ Kassel, Inst Math, D-34132 Kassel, Germany
关键词
Supercomputer; performance analysis; I/O;
D O I
10.1145/3041710.3041716
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Keeping compute and I/O performance balanced is a major challenge for future cost-efficient HPC systems. Several architectural concepts and new technologies allow to address this challenge, however at the price of higher complexity. As a result, the need emerges to simulate these architectural concepts and new technologies to predict their impact on the overall performance. In this paper we propose a particular approach to explore the design space using event simulation models that take I/O server-side performance counters as input. In this way large quantities of real-life data measured over a large number of applications can be used to explore architectural modifications. We apply our approach using data collected by a GPFS file system serving a petascale Blue Gene/P installation.
引用
收藏
页码:37 / 46
页数:10
相关论文
共 50 条
  • [1] Parallel I/O Architecture Modelling Based on File System Counters
    El Sayed, Salem
    Bolten, Matthias
    Pleiter, Dirk
    [J]. HIGH PERFORMANCE COMPUTING, ISC HIGH PERFORMANCE 2016 INTERNATIONAL WORKSHOPS, 2016, 9945 : 627 - 637
  • [2] MPI-I/O with a shared file pointer using a parallel virtual file system in remote I/O operations
    Tsujita, Y
    [J]. DISTRIBUTED AND PARALLEL SYSTEMS: CLUSTER AND GRID COMPUTING, 2005, 777 : 47 - 54
  • [3] Benchmarking Parallel File System Sensitiveness to I/O patterns
    Chasapis, Konstantinos
    Vet, Jean-Yves
    Acquaviva, Jean-Thomas
    [J]. 2019 IEEE 27TH INTERNATIONAL SYMPOSIUM ON MODELING, ANALYSIS, AND SIMULATION OF COMPUTER AND TELECOMMUNICATION SYSTEMS (MASCOTS 2019), 2019, : 427 - 428
  • [4] UFCR: An efficient I/O method for parallel file system
    Huo, Yanmei
    Ju, Jiubin
    Hu, Liang
    [J]. SEVENTH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED COMPUTING, APPLICATIONS AND TECHNOLOGIES, PROCEEDINGS, 2006, : 223 - +
  • [5] Distributed parallel file system for I/O intensive parallel computing on clusters
    Domínguez-Domínguez, S
    Buenabad-Chávez, J
    [J]. 2004 1st International Conference on Electrical and Electronics Engineering (ICEEE), 2004, : 194 - 199
  • [6] Enabling dynamic file I/O path selection at runtime for parallel file system
    Xiuqiao Li
    Limin Xiao
    Meikang Qiu
    Bin Dong
    Li Ruan
    [J]. The Journal of Supercomputing, 2014, 68 : 996 - 1021
  • [7] Parallel I/O Prefetching Using MPI File Caching and I/O Signatures
    Byna, Surendra
    Chen, Yong
    Sun, Xian-He
    Thakur, Rajeev
    Gropp, William
    [J]. INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS, 2008, : 350 - +
  • [8] Enabling dynamic file I/O path selection at runtime for parallel file system
    Li, Xiuqiao
    Xiao, Limin
    Qiu, Meikang
    Dong, Bin
    Ruan, Li
    [J]. JOURNAL OF SUPERCOMPUTING, 2014, 68 (02): : 996 - 1021
  • [9] FILE CONCEPTS FOR PARALLEL I/O
    CROCKETT, TW
    [J]. PROCEEDINGS : SUPERCOMPUTING 89, 1989, : 574 - 579
  • [10] A File Assignment Strategy for Parallel I/O System with Minimum I/O Contention Probability
    Dong, Bin
    Li, Xiuqiao
    Xiao, Limin
    Ruan, Li
    [J]. GRID AND DISTRIBUTED COMPUTING, 2011, 261 : 445 - 454