Benchmarking Parallel File System Sensitiveness to I/O patterns

被引:2
|
作者
Chasapis, Konstantinos [1 ]
Vet, Jean-Yves [1 ]
Acquaviva, Jean-Thomas [1 ]
机构
[1] DDN Storage, Paris, France
关键词
parallel file systems; benchmarking; IO500; I/O patterns;
D O I
10.1109/MASCOTS.2019.00054
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the raise of data analytic and more generally data intensive computing, the traditional benchmarking of parallel file systems is stretched to its limits. While often promoted on their peak performance, most have difficulties to cope with the complex I/O patterns often observed in modern applications. This results in limited insights if not misleading information for end-users. The community has reacted by developing more sophisticated measurement tools and methodology, the most preeminent effort at the moment is the emerging IO500 benchmark. In this paper, we investigate the impact of the I/O access patterns on parallel file systems. Starting with the IO500 benchmark, the measurements demonstrate how specific patterns can be handled safely by some file systems, while at the opposite impact dramatically performance on others.
引用
收藏
页码:427 / 428
页数:2
相关论文
共 50 条
  • [1] Algorithmic influences on I/O access patterns and parallel file system performance
    Smirni, E
    Elford, CE
    Lavery, AJ
    Chien, AA
    [J]. 1997 INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS, PROCEEDINGS, 1997, : 794 - 801
  • [2] UFCR: An efficient I/O method for parallel file system
    Huo, Yanmei
    Ju, Jiubin
    Hu, Liang
    [J]. SEVENTH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED COMPUTING, APPLICATIONS AND TECHNOLOGIES, PROCEEDINGS, 2006, : 223 - +
  • [3] Distributed parallel file system for I/O intensive parallel computing on clusters
    Domínguez-Domínguez, S
    Buenabad-Chávez, J
    [J]. 2004 1st International Conference on Electrical and Electronics Engineering (ICEEE), 2004, : 194 - 199
  • [4] Enabling dynamic file I/O path selection at runtime for parallel file system
    Xiuqiao Li
    Limin Xiao
    Meikang Qiu
    Bin Dong
    Li Ruan
    [J]. The Journal of Supercomputing, 2014, 68 : 996 - 1021
  • [5] Enabling dynamic file I/O path selection at runtime for parallel file system
    Li, Xiuqiao
    Xiao, Limin
    Qiu, Meikang
    Dong, Bin
    Ruan, Li
    [J]. JOURNAL OF SUPERCOMPUTING, 2014, 68 (02): : 996 - 1021
  • [6] FILE CONCEPTS FOR PARALLEL I/O
    CROCKETT, TW
    [J]. PROCEEDINGS : SUPERCOMPUTING 89, 1989, : 574 - 579
  • [7] A File Assignment Strategy for Parallel I/O System with Minimum I/O Contention Probability
    Dong, Bin
    Li, Xiuqiao
    Xiao, Limin
    Ruan, Li
    [J]. GRID AND DISTRIBUTED COMPUTING, 2011, 261 : 445 - 454
  • [8] Parallel I/O Architecture Modelling Based on File System Counters
    El Sayed, Salem
    Bolten, Matthias
    Pleiter, Dirk
    [J]. HIGH PERFORMANCE COMPUTING, ISC HIGH PERFORMANCE 2016 INTERNATIONAL WORKSHOPS, 2016, 9945 : 627 - 637
  • [9] MPI-I/O with a shared file pointer using a parallel virtual file system in remote I/O operations
    Tsujita, Y
    [J]. DISTRIBUTED AND PARALLEL SYSTEMS: CLUSTER AND GRID COMPUTING, 2005, 777 : 47 - 54
  • [10] Using file system counters in modelling parallel I/O architectures
    El Sayed, Salem
    Bolten, Matthias
    Pleiter, Dirk
    [J]. OPERATING SYSTEMS REVIEW, 2016, 50 (02) : 37 - 46