Using file system counters in modelling parallel I/O architectures

被引:0
|
作者
El Sayed, Salem [1 ]
Bolten, Matthias [2 ]
Pleiter, Dirk [1 ]
机构
[1] Forschungszentrum Julich, Julich Supercomp Ctr, D-52425 Julich, Germany
[2] Univ Kassel, Inst Math, D-34132 Kassel, Germany
关键词
Supercomputer; performance analysis; I/O;
D O I
10.1145/3041710.3041716
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Keeping compute and I/O performance balanced is a major challenge for future cost-efficient HPC systems. Several architectural concepts and new technologies allow to address this challenge, however at the price of higher complexity. As a result, the need emerges to simulate these architectural concepts and new technologies to predict their impact on the overall performance. In this paper we propose a particular approach to explore the design space using event simulation models that take I/O server-side performance counters as input. In this way large quantities of real-life data measured over a large number of applications can be used to explore architectural modifications. We apply our approach using data collected by a GPFS file system serving a petascale Blue Gene/P installation.
引用
收藏
页码:37 / 46
页数:10
相关论文
共 50 条
  • [31] Dynamic File Striping and Data Layout Transformation on Parallel System with Fluctuating I/O Workload
    Son, Seung Woo
    Sehrish, Saba
    Liao, Wei-keng
    Oldfield, Ron
    Choudhary, Alok
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING (CLUSTER), 2013,
  • [32] Dynamically Adapting File Domain Partitioning Methods for Collective I/O Based on Underlying Parallel File System Locking Protocols
    Liao, Wei-keng
    Choudhary, Alok
    [J]. INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS, 2008, : 420 - 431
  • [33] PARALLEL ARCHITECTURES I
    PISSALOUX, EE
    [J]. MICROPROCESSING AND MICROPROGRAMMING, 1992, 35 (1-5): : 537 - 538
  • [34] I/O OVERHEAD AND PARALLEL VLSI ARCHITECTURES FOR LATTICE COMPUTATIONS
    NODINE, MH
    LOPRESTI, DP
    VITTER, JS
    [J]. IEEE TRANSACTIONS ON COMPUTERS, 1991, 40 (07) : 843 - 852
  • [35] I/O OVERHEAD AND PARALLEL VLSI ARCHITECTURES FOR LATTICE COMPUTATIONS
    NODINE, MH
    LOPRESTI, DP
    VITTER, JS
    [J]. LECTURE NOTES IN COMPUTER SCIENCE, 1990, 468 : 497 - 506
  • [36] Write Optimization of Log-structured Flash File System for Parallel I/O on Manycore Servers
    Lee, Chang-Gyu
    Byun, Hyunki
    Noh, Sunghyun
    Kang, Hyeongu
    Kim, Youngjae
    [J]. SYSTOR '19: PROCEEDINGS OF THE 12TH ACM INTERNATIONAL SYSTEMS AND STORAGE CONFERENCE, 2019, : 21 - 32
  • [37] Parallel I/O Characterisation Based on Server-Side Performance Counters
    El Sayed, Salem
    Bolten, Matthias
    Pleiter, Dirk
    Frings, Wolfgang
    [J]. PROCEEDINGS OF PDSW-DISCS 2016 - 1ST JOINT INTERNATIONAL WORKSHOP ON PARALLEL DATA STORAGE AND DATA INTENSIVE SCALABLE COMPUTING SYSTEMS, 2016, : 7 - 12
  • [38] PIOD: A Parallel I/O Dispatch Model Based on Lustre File System for Virtual Machine Storage
    Lei, Zhou
    Zhou, Zhebo
    Hu, Bolin
    Shen, Wenfeng
    Hu, Luokai
    [J]. 2013 INTERNATIONAL CONFERENCE ON CLOUD AND SERVICE COMPUTING (CSC 2013), 2013, : 30 - 35
  • [39] Parallel file system testing for the lunatic fringe: The care and feeding of restless I/O power users
    Hedges, R
    Loewe, B
    McLarty, T
    Morrone, C
    [J]. Twenty-Second IEEE/Thirteenth NASA Goddard Conference on Mass Storage Systems and Technologies, Proceedings: INFORMATION RETRIEVAL FROM VERY LARGE STORAGE SYSTEMS, 2005, : 3 - 17
  • [40] Automatic I/O scheduling algorithm selection for parallel file systems
    Boito, Francieli Zanon
    Kassick, Rodrigo Virote
    Navaux, Philippe O. A.
    Denneulin, Yves
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2016, 28 (08): : 2457 - 2472