The practice of I/O optimizations for out-of-core computation

被引：0
|
作者：
Tang, JQ [1 ]
Fang, BX [1 ]
Hu, MZ [1 ]
Zhang, HL [1 ]
机构：
[1] Harbin Inst Technol, Dept Comp Sci & Engn, Harbin 150001, Peoples R China
来源：
PARALLEL AND DISTRIBUTED COMPUTING: APPLICATIONS AND TECHNOLOGIES, PROCEEDINGS | 2004年 / 3320卷
关键词：
D O I：
暂无
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
Out-of-core computation needs high I/O performance as the out-of-core data stored in files has to be moved between memory and disks during the execution of an application program. In order to obtain better performance of out-of-core programs, two I/O optimizations are practiced, which are data prefetching and data reuse. This paper focuses on discussing the mechanism and implementation of each method and under which condition a method should be used. Several sets of experiments are taken to test the strategies and the results show that the I/O performance is efficiently improved by using thew optimization methods.
引用
收藏
页码：81 / 85
页数：5
相关论文
共 50 条
  • [21] Disk resident arrays: An array-oriented I/O library for out-of-core computations
    Nieplocha, J
    Foster, I
    FRONTIERS '96 - THE SIXTH SYMPOSIUM ON FRONTIERS OF MASSIVELY PARALLEL COMPUTING, PROCEEDINGS, 1996, : 196 - 204
  • [22] The out-of-core KNN awakens: the light side of computation force on large datasets
    Javier Olivares
    Anne-Marie Kermarrec
    Nitin Chiluka
    Computing, 2019, 101 : 19 - 38
  • [23] The out-of-core KNN awakens: the light side of computation force on large datasets
    Olivares, Javier
    Kermarrec, Anne-Marie
    Chiluka, Nitin
    COMPUTING, 2019, 101 (01) : 19 - 38
  • [24] Out-of-core mls reconstruction
    Fiorin, Valentino
    Cignoni, Paolo
    Scopigno, Roberto
    PROCEEDINGS OF THE NINTH IASTED INTERNATIONAL CONFERENCE ON COMPUTER GRAPHICS AND IMAGING, 2007, : 27 - 34
  • [25] Minimizing I/Os in Out-of-Core Task Tree Scheduling
    Marchal, Loris
    McCauley, Samuel
    Simon, Bertrand
    Vivien, Frederic
    INTERNATIONAL JOURNAL OF FOUNDATIONS OF COMPUTER SCIENCE, 2023, 34 (01) : 51 - 80
  • [26] A Cholesky out-of-core factorization
    Castellanos, J. A.
    Larrazabal, G.
    MATHEMATICAL AND COMPUTER MODELLING, 2013, 57 (9-10) : 2207 - 2222
  • [27] The Out-of-core KNN Awakens: The Light Side of Computation Force on Large Datasets
    Chiluka, Nitin
    Kermarrec, Anne-Marie
    Olivares, Javier
    NETWORKED SYSTEMS, NETYS 2016, 2016, 9944 : 295 - 310
  • [28] Squeezing out All the Value of Loaded Data: An Out-of-core Graph Processing System with Reduced Disk I/O
    Ai, Zhiyuan
    Zhang, Mingxing
    Wu, Yongwei
    Qian, Xuehai
    Chen, Kang
    Zheng, Weimin
    2017 USENIX ANNUAL TECHNICAL CONFERENCE (USENIX ATC '17), 2017, : 125 - 137
  • [29] Accelerating GPU-Based Out-of-Core Stencil Computation with On-the-Fly Compression
    Shen, Jingcheng
    Wu, Yifan
    Okita, Masao
    Ino, Fumihiko
    PARALLEL AND DISTRIBUTED COMPUTING, APPLICATIONS AND TECHNOLOGIES, PDCAT 2021, 2022, 13148 : 3 - 14
  • [30] Amy files for out-of-core computations
    Zhang, Y
    Apon, A
    Pulay, P
    PDPTA'03: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, VOLS 1-4, 2003, : 191 - 197
12345