Adaptive disk striping for parallel input/output

被引:9
|
作者
Simitci, H [1 ]
Reed, DA [1 ]
机构
[1] Univ Illinois, Dept Comp Sci, Urbana, IL 61801 USA
关键词
D O I
10.1109/MASS.1999.829996
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As disk capacities continue to rise more rapidly than transfer rates, adaptive, redundant striping smoothly trades capacity for higher performance. We developed a fuzzy logic rule base for adaptive, redundant striping of files across multiple disks. This rule base is based on a queuing model of disk contention that includes file request sizes and disk hardware parameters. At low loads, the rule base stripes aggressively to minimize response time. As loads rise, it stripes less aggressively to maximize aggregate throughput. This adaptive striping rule base is incorporated into our second generation Portable Parallel File System (PPFS II). Experimental results showed that the analytical models of disk striping are capable of accurately predicting file system behavior. Also, it is shown that, depending on the access pattern, adaptive striping can double the input/output performance compared to striping with fixed distribution parameters.
引用
收藏
页码:88 / 102
页数:15
相关论文
共 50 条
  • [1] An adaptive cache coherence protocol specification for parallel input/output systems
    Garcia-Carballeira, F
    Carretero, J
    Calderon, A
    Perez, JM
    Garcia, JD
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2004, 15 (06) : 533 - 545
  • [2] Automatic-adaptive file striping of parallel file system
    School of Computer Science and Engineering, South China University of Technology, Guangzhou 510641, China
    不详
    Jisuanji Gongcheng, 2006, 15 (78-80):
  • [3] Parallel input/output with heterogeneous disks
    Kuo, S
    Winslett, M
    Chen, Y
    Cho, Y
    Subramaniam, M
    Seamons, K
    NINTH INTERNATIONAL CONFERENCE ON SCIENTIFIC AND STATISTICAL DATABASE MANAGEMENT, PROCEEDINGS, 1997, : 79 - 90
  • [4] Classification of parallel input/output products
    Stockinger, H
    INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, VOLS I-IV, PROCEEDINGS, 1998, : 469 - 476
  • [5] Adaptive HPC Input/Output Systems
    Carretero, Jesus
    Garcia-Blas, Javier
    Brinkmann, Andre
    Vel, Marc
    Besnard, Jean-Baptiste
    Torquati, Massimo
    Ju, Yi
    Montella, Raffaele
    EURO-PAR 2023: PARALLEL PROCESSING WORKSHOPS, PT II, EURO-PAR 2023, 2024, 14352 : 199 - 202
  • [6] PIPORS: a parallel input parallel output register switching system
    Tao, DF
    Lee, LT
    COMPUTERS & ELECTRICAL ENGINEERING, 2004, 30 (06) : 427 - 440
  • [7] INPUT-OUTPUT OPTIMIZATION AND DISK ARCHITECTURES - A SURVEY
    SMITH, AJ
    PERFORMANCE EVALUATION, 1981, 1 (02) : 104 - 117
  • [8] ViPIOS: The Vienna parallel input/output system
    Schikuta, E
    Fuerle, T
    Wanek, H
    EURO-PAR '98 PARALLEL PROCESSING, 1998, 1470 : 953 - 958
  • [9] PIGO: A Parallel Graph Input/Output Library
    Gabert, Kasimir
    Catalyurek, Umit, V
    2021 IEEE INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW), 2021, : 276 - 279
  • [10] Disk striping in video server environments
    Ozden, B
    Rastogi, R
    Silberschatz, A
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON MULTIMEDIA COMPUTING AND SYSTEMS, 1996, : 580 - 589