A novel cluster parallel file system

被引:0
|
作者
Wei, Wenguo [1 ,2 ]
Dong, Shoubin [1 ]
Zhang, Ling [1 ]
Li, Jialin [1 ]
机构
[1] South China Univ Technol, Guangdong Key Lab Comp Network, Guangzhou 510641, Peoples R China
[2] Guangdong Polytech Normal Univ, Dept Comp Sci, Guangzhou 510665, Guangdong, Peoples R China
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a novel cluster parallel file system: High-throughput & Scalable Parallel File System (HTSPFS). There are some new features in it such as automatic adaptive file striping policy based on file size, request arrival rate, concurrent of accessing files, storage servers' networking and disk performance; prefetching read-request and writing behind write-request to enable a higher throughput in HTSPFS. We give a detail discuss of Markov spatial predicting method for read request, experiment results show that Markov predicting technology has high prediction veracity. Overall, HTSPFS has some autonomics characteristics.
引用
收藏
页码:119 / +
页数:2
相关论文
共 50 条
  • [41] A high availability mechanism for parallel file system
    Zhang, H
    Wu, WG
    Dong, XS
    Qian, DP
    [J]. ADVANCED PARALLEL PROCESSING TECHNOLOGIES, PROCEEDINGS, 2005, 3756 : 194 - 203
  • [42] PVFS: A parallel file system for Linux clusters
    Carns, PH
    Ligon, WB
    Ross, RB
    Thakur, R
    [J]. USENIX ASSOCIATION PROCEEDINGS OF THE 4TH ANNUAL LINUX SHOWCASE AND CONFERENCE, ATLANTA, 2000, : 317 - 327
  • [43] Performing Cloud Computation on a Parallel File System
    Wilson, Ellis
    [J]. 2012 SC COMPANION: HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS (SCC), 2012, : 1545 - 1545
  • [44] HySF: A Striped File Assignment Strategy for Parallel File System with Hybrid Storage
    Zhu, Mingfa
    Li, Guoying
    Ruan, Li
    Xie, Ke
    Xiao, Limin
    [J]. 2013 IEEE 15TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS & 2013 IEEE INTERNATIONAL CONFERENCE ON EMBEDDED AND UBIQUITOUS COMPUTING (HPCC_EUC), 2013, : 511 - 517
  • [45] A performance improvement of shared storage cluster file system
    Choi, C
    Chung, JY
    Kim, S
    [J]. PDPTA'2001: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, 2001, : 1962 - 1967
  • [46] File Repair with Cluster Based Distributed Storage System
    Haytaoglu, Elif
    Dalkilic, Mehmet Emin
    [J]. 2017 25TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2017,
  • [47] Scalability and failure recovery in a Linux cluster file system
    Preslan, KW
    Barry, A
    Brassow, J
    [J]. USENIX ASSOCIATION PROCEEDINGS OF THE 4TH ANNUAL LINUX SHOWCASE AND CONFERENCE, ATLANTA, 2000, : 169 - 180
  • [48] A storage space management policy for a cluster file system
    Xiong, Jin
    Tang, Rongfeng
    Fan, Zhihua
    Ma, Jie
    Li, Hui
    Meng, Dan
    Sun, Ninghui
    Li, Guojie
    [J]. Eighth International Conference on High-Performance Computing in Asia-Pacific Region, Proceedings, 2005, : 240 - 245
  • [49] The MOSIX Direct File System Access Method for Supporting Scalable Cluster File Systems
    Lior Amar
    Amnon Barak
    Amnon Shiloh
    [J]. Cluster Computing, 2004, 7 (2) : 141 - 150
  • [50] An Expandable Parallel File System using NFS servers
    García, F
    Calderón, A
    Carretero, J
    Pérez, JM
    Fernández, J
    [J]. HIGH PERFORMANCE COMPUTING FOR COMPUTATIONAL SCIENCE - VECPAR 2002, 2003, 2565 : 565 - 578