UFCR: An efficient I/O method for parallel file system

被引:0
|
作者
Huo, Yanmei [1 ]
Ju, Jiubin [1 ]
Hu, Liang [1 ]
机构
[1] Jilin Univ, Coll Comp Sci & Technol, Changsha 130012, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
One important way of solving 110 bottleneck is to develop parallel file system. Research showed that the strided file access pattern in scientific applications combined with current file system methods to perform these accesses lead to unacceptable performance for large data access. To enhance performance of discontiguous data access, we have created a new high performance 110 method: the user-defined file view and combining 110 requests (UFCR). We have implemented our ideas on WPFS. Experimentation results showed that our method can substantially enhance the performance of scientific applications.
引用
收藏
页码:223 / +
页数:3
相关论文
共 50 条
  • [41] Parallel Geospatial Raster Data I/O Using File View
    Xiong, Wei
    Wu, Ye
    Chen, Luo
    Jing, Ning
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2015, E98D (12): : 2192 - 2195
  • [42] Efficient parallel I/O in seismic imaging
    Oldfield, RA
    Womble, DE
    Ober, CC
    [J]. INTERNATIONAL JOURNAL OF HIGH PERFORMANCE COMPUTING APPLICATIONS, 1998, 12 (03): : 333 - 344
  • [43] Adaptive file prefetching in parallel file system
    Hwang-Bo, JH
    Lim, JD
    Seo, DW
    [J]. PDPTA'2001: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, 2001, : 1919 - 1924
  • [44] An Architecture for High Performance File System I/O
    Patocka, Mikulas
    [J]. PROCEEDINGS OF WORLD ACADEMY OF SCIENCE, ENGINEERING AND TECHNOLOGY, VOL 23, 2007, 23 : 250 - 255
  • [45] A dynamic and adaptive load balancing strategy for parallel file system with large-scale I/O servers
    Dong, Bin
    Li, Xiuqiao
    Wu, Qimeng
    Xiao, Limin
    Ruan, Li
    [J]. JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2012, 72 (10) : 1254 - 1268
  • [46] A non-partitioning file assignment scheme with approximating average waiting time in parallel I/O system
    Yao, Nianmin
    Chen, Jinzhong
    Cai, Shaobin
    [J]. Journal of Software, 2013, 8 (02) : 302 - 309
  • [47] Optimization of nonblocking MPI-I/O to a remote parallel virtual file system using a circular buffer
    Tsujita, Y
    [J]. HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS, PROCEEDINGS, 2005, 3726 : 585 - 594
  • [48] The Vesta parallel file system
    Corbett, PF
    Feitelson, DG
    [J]. ACM TRANSACTIONS ON COMPUTER SYSTEMS, 1996, 14 (03): : 225 - 264
  • [49] The Galley parallel file system
    Nieuwejaar, N
    Kotz, D
    [J]. PARALLEL COMPUTING, 1997, 23 (4-5) : 447 - 476
  • [50] Simplifying Index File Structure to Improve I/O Performance of Parallel Indexing
    Chiu, Hsuan-Te
    Chou, Jerry
    Vishwanath, Venkat
    Byna, Surendra
    Wu, Kesheng
    [J]. 2014 20TH IEEE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS), 2014, : 576 - 583