Heuristic file sorted assignment algorithm of parallel I/O on cluster computing system

被引:0
|
作者
Zhi-gang Chen
Bi-qing Zeng
Ce Xiong
Xiao-heng Deng
Zhi-wen Zeng
An-feng Liu
机构
[1] Central South University,School of Information Science and Engineering
关键词
cluster computing; parallel I/O; file sorted assignment; variance of service time; TP338.8;
D O I
暂无
中图分类号
学科分类号
摘要
A new file assignment strategy of parallel I/O, which is named heuristic file sorted assignment algorithm was proposed on cluster computing system. Based on the load balancing, it assigns the files to the same disk according to the similar service time. Firstly, the files were sorted and stored at the set I in descending order in terms of their service time, then one disk of cluster node was selected randomly when the files were to be assigned, and at last the continuous files were taken orderly from the set I to the disk until the disk reached its load maximum. The experimental results show that the new strategy improves the performance by 20.2% when the load of the system is light and by 31.6% when the load is heavy. And the higher the data access rate, the more evident the improvement of the performance obtained by the heuristic file sorted assignment algorithm.
引用
收藏
页码:572 / 577
页数:5
相关论文
共 50 条
  • [1] Heuristic file sorted assignment algorithm of parallel I/O on cluster computing system
    Chen, ZG
    Zeng, BQ
    Xiong, C
    Deng, XH
    Zeng, ZW
    Liu, AF
    [J]. JOURNAL OF CENTRAL SOUTH UNIVERSITY OF TECHNOLOGY, 2005, 12 (05): : 572 - 577
  • [2] Heuristic file sorted assignment algorithm of parallel I/O on cluster computing system
    陈志刚
    曾碧卿
    熊策
    邓晓衡
    曾志文
    刘安丰
    [J]. Journal of Central South University, 2005, (05) : 572 - 577
  • [3] A HEURISTIC ALGORITHM FOR THE RELIABILITY-ORIENTED FILE ASSIGNMENT IN A DISTRIBUTED COMPUTING SYSTEM
    CHEN, DJ
    HOL, WC
    CHEN, RS
    CHEN, DTK
    [J]. COMPUTERS & MATHEMATICS WITH APPLICATIONS, 1995, 29 (10) : 85 - 104
  • [4] Distributed parallel file system for I/O intensive parallel computing on clusters
    Domínguez-Domínguez, S
    Buenabad-Chávez, J
    [J]. 2004 1st International Conference on Electrical and Electronics Engineering (ICEEE), 2004, : 194 - 199
  • [5] A File Assignment Strategy for Parallel I/O System with Minimum I/O Contention Probability
    Dong, Bin
    Li, Xiuqiao
    Xiao, Limin
    Ruan, Li
    [J]. GRID AND DISTRIBUTED COMPUTING, 2011, 261 : 445 - 454
  • [6] File assignment in parallel I/O systems with minimal variance of service time
    Lee, LW
    Scheuermann, P
    Vingralek, R
    [J]. IEEE TRANSACTIONS ON COMPUTERS, 2000, 49 (02) : 127 - 140
  • [7] A novel cluster parallel file system
    Wei, Wenguo
    Dong, Shoubin
    Zhang, Ling
    Li, Jialin
    [J]. SEVENTEENTH INTERNATIONAL CONFERENCE ON DATABASE AND EXPERT SYSTEMS APPLICATIONS, PROCEEDINGS, 2006, : 119 - +
  • [8] Parallel I/O scheduling in multiprogrammed cluster computing systems
    Abawajy, JH
    [J]. COMPUTATIONAL SCIENCE - ICCS 2003, PT IV, PROCEEDINGS, 2003, 2660 : 223 - 229
  • [9] A non-partitioning file assignment scheme with approximating average waiting time in parallel I/O system
    Yao, Nianmin
    Chen, Jinzhong
    Cai, Shaobin
    [J]. Journal of Software, 2013, 8 (02) : 302 - 309
  • [10] Automatic I/O scheduling algorithm selection for parallel file systems
    Boito, Francieli Zanon
    Kassick, Rodrigo Virote
    Navaux, Philippe O. A.
    Denneulin, Yves
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2016, 28 (08): : 2457 - 2472