A novel cluster parallel file system

被引:0
|
作者
Wei, Wenguo [1 ,2 ]
Dong, Shoubin [1 ]
Zhang, Ling [1 ]
Li, Jialin [1 ]
机构
[1] South China Univ Technol, Guangdong Key Lab Comp Network, Guangzhou 510641, Peoples R China
[2] Guangdong Polytech Normal Univ, Dept Comp Sci, Guangzhou 510665, Guangdong, Peoples R China
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a novel cluster parallel file system: High-throughput & Scalable Parallel File System (HTSPFS). There are some new features in it such as automatic adaptive file striping policy based on file size, request arrival rate, concurrent of accessing files, storage servers' networking and disk performance; prefetching read-request and writing behind write-request to enable a higher throughput in HTSPFS. We give a detail discuss of Markov spatial predicting method for read request, experiment results show that Markov predicting technology has high prediction veracity. Overall, HTSPFS has some autonomics characteristics.
引用
收藏
页码:119 / +
页数:2
相关论文
共 50 条
  • [1] An efficient parallel file system for cluster grids
    Frattolillo, F
    D'Onofrio, S
    [J]. RECENT ADVANCES IN PARALLEL VIRTUAL MACHINE AND MESSAGE PASSING INTERFACE, PROCEEDINGS, 2005, 3666 : 94 - 101
  • [2] Cooperative caching in the pCFS parallel cluster file system
    Lopes, Paulo A.
    Medeiros, Pedro D.
    [J]. HPDC-15: PROCEEDINGS OF THE 15TH IEEE INTERNATIONAL SYMPOSIUM ON HIGH PERFORMANCE DISTRIBUTED COMPUTING, 2005, : 347 - 348
  • [3] Providing PVM with a parallel file system for cluster grids
    Frattolillo, Franco
    D'Onofrio, Salvatore
    [J]. WMSCI 2005: 9th World Multi-Conference on Systemics, Cybernetics and Informatics, Vol 3, 2005, : 24 - 29
  • [4] pCFS vs. PVFS: Comparing a Highly-Available Symmetrical Parallel Cluster File System with an Asymmetrical Parallel File System
    Lopes, Paulo A.
    Medeiros, Pedro D.
    [J]. EURO-PAR 2010 PARALLEL PROCESSING, PT I, 2010, 6271 : 131 - +
  • [5] RRBS: A fault tolerance model for cluster/grid parallel file system
    Huo, YM
    Ju, JB
    Hu, L
    [J]. PARALLEL AND DISTRIBUTED PROCESSING AND APPLICATIONS, 2005, 3758 : 180 - 187
  • [6] Parallel Query Processing in a Cluster using MPI and File System Caching
    Iyengar, N. Ch. S. N.
    Huda, Monis
    Juneja, Pranav
    Jain, Saurabh
    Vijayasherly, V.
    [J]. INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2009, 9 (05): : 249 - 254
  • [7] Adaptive file prefetching in parallel file system
    Hwang-Bo, JH
    Lim, JD
    Seo, DW
    [J]. PDPTA'2001: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, 2001, : 1919 - 1924
  • [8] The Vesta parallel file system
    Corbett, PF
    Feitelson, DG
    [J]. ACM TRANSACTIONS ON COMPUTER SYSTEMS, 1996, 14 (03): : 225 - 264
  • [9] The Galley parallel file system
    Nieuwejaar, N
    Kotz, D
    [J]. PARALLEL COMPUTING, 1997, 23 (4-5) : 447 - 476
  • [10] A parallel file system for a virtual parallel machine
    Castro, H
    Castañeda, S
    [J]. INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, VOLS I-V, PROCEEDINGS, 1999, : 807 - 813