Using file system counters in modelling parallel I/O architectures

被引:0
|
作者
El Sayed, Salem [1 ]
Bolten, Matthias [2 ]
Pleiter, Dirk [1 ]
机构
[1] Forschungszentrum Julich, Julich Supercomp Ctr, D-52425 Julich, Germany
[2] Univ Kassel, Inst Math, D-34132 Kassel, Germany
关键词
Supercomputer; performance analysis; I/O;
D O I
10.1145/3041710.3041716
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Keeping compute and I/O performance balanced is a major challenge for future cost-efficient HPC systems. Several architectural concepts and new technologies allow to address this challenge, however at the price of higher complexity. As a result, the need emerges to simulate these architectural concepts and new technologies to predict their impact on the overall performance. In this paper we propose a particular approach to explore the design space using event simulation models that take I/O server-side performance counters as input. In this way large quantities of real-life data measured over a large number of applications can be used to explore architectural modifications. We apply our approach using data collected by a GPFS file system serving a petascale Blue Gene/P installation.
引用
收藏
页码:37 / 46
页数:10
相关论文
共 50 条
  • [21] I/O response time in a fault-tolerant parallel virtual file system
    Feng, D
    Jiang, H
    Zhu, YF
    [J]. NETWORK AND PARALLEL COMPUTING, PROCEEDINGS, 2004, 3222 : 248 - 251
  • [22] Heuristic file sorted assignment algorithm of parallel I/O on cluster computing system
    Chen, ZG
    Zeng, BQ
    Xiong, C
    Deng, XH
    Zeng, ZW
    Liu, AF
    [J]. JOURNAL OF CENTRAL SOUTH UNIVERSITY OF TECHNOLOGY, 2005, 12 (05): : 572 - 577
  • [23] Performance analysis of parallel file system for I/O load balancing in distributed applications
    Deepalakshmi, S
    Baswaraj, K
    Rao, SSSP
    Jagdish, BS
    Sonavane, DD
    Dhekne, PS
    Kaura, HK
    [J]. PDPTA'03: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, VOLS 1-4, 2003, : 713 - 720
  • [24] Heuristic file sorted assignment algorithm of parallel I/O on cluster computing system
    陈志刚
    曾碧卿
    熊策
    邓晓衡
    曾志文
    刘安丰
    [J]. Journal of Central South University, 2005, (05) : 572 - 577
  • [25] Heuristic file sorted assignment algorithm of parallel I/O on cluster computing system
    Zhi-gang Chen
    Bi-qing Zeng
    Ce Xiong
    Xiao-heng Deng
    Zhi-wen Zeng
    An-feng Liu
    [J]. Journal of Central South University of Technology, 2005, 12 : 572 - 577
  • [26] Novel Architectures for Efficient (m, n) Parallel Counters
    Veeramachaneni, Sreehari
    Avinash, Lingamneni
    Krishna, M. Kirthi
    Srinivas, M. B.
    [J]. GLSVLSI'07: PROCEEDINGS OF THE 2007 ACM GREAT LAKES SYMPOSIUM ON VLSI, 2007, : 188 - 191
  • [27] Evaluation of collective I/O implementations on parallel architectures
    Dickens, PM
    Thakur, R
    [J]. JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2001, 61 (08) : 1052 - 1076
  • [28] On evaluating decentralized parallel I/O scheduling strategies for parallel file systems
    Isaila, Florin
    Singh, David
    Carretero, Jesus
    Garcia, Felix
    [J]. HIGH PERFORMANCE COMPUTING FOR COMPUTATIONAL SCIENCE - VECPAR 2006, 2007, 4395 : 120 - +
  • [29] Enhanced file interoperability with parallel MPI File-I/O in image processing
    Piriyakumar, DAL
    Levi, P
    Rabenseifner, R
    [J]. RECENT ADVANCES IN PARALLEL VIRTUAL MACHINE AND MESSAGE PASSING INTERFACE, PROCEEDINGS, 2002, 2474 : 174 - 182
  • [30] An overview of file system architectures
    Isaila, F
    [J]. ALGORITHMS FOR MEMORY HIERARCHIES: ADVANCED LECTURES, 2003, 2625 : 273 - 289