An RNN Based Mechanism for File Prefetching

被引:8
|
作者
Chen, Hui [1 ]
Zhou, Enqiang [1 ]
Liu, Jie [1 ]
Zhang, Zhicheng [1 ]
机构
[1] Natl Univ Def Technol, Sch Comp Sci, Changsha, Hunan, Peoples R China
关键词
Distributed File System; File Prefetching; Word Embedding; RNN;
D O I
10.1109/DCABES48411.2019.00011
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Many applications spend a large proportion of the execution time to access files. To narrow the increasing gap between computing and I/O performance, several optimization techniques were adopted, such as data prefetching and data layout optimization. However, the effectiveness of these optimization processes heavily depends on the understanding of the I/O behavior. Traditionally, spatial locality and temporal locality are mainly considered for data prefetching and scheduling policy. Whereas for most real-world workloads, the file access pattern is hard to capture. For the goal of deeply and intelligently understanding the I/O access pattern of modern applications, and efficiently optimizing the performance of current file systems, we propose a new mechanism to embed file names to vectors and train a gated recurrent neural network to provide policies for file prefetching and cache replacing.
引用
收藏
页码:13 / 16
页数:4
相关论文
共 50 条
  • [1] Aggregating caches: A mechanism for implicit file prefetching
    Amer, A
    Long, DDE
    [J]. NINTH INTERNATIONAL SYMPOSIUM ON MODELING, ANALYSIS AND SIMULATION OF COMPUTER AND TELECOMMUNICATION SYSTEMS, PROCEEDINGS, 2001, : 293 - 301
  • [2] Register File Prefetching
    Shukla, Sudhanshu
    Bandishte, Sumeet
    Gaur, Jayesh
    Subramoney, Sreenivas
    [J]. PROCEEDINGS OF THE 2022 THE 49TH ANNUAL INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE (ISCA '22), 2022, : 410 - 423
  • [3] Dynamic file prefetching scheme based on file access patterns in VIA-based parallel file system
    Lee, YY
    Kim, CY
    Seo, DW
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2002, E85D (04) : 714 - 721
  • [4] Adaptive file prefetching in parallel file system
    Hwang-Bo, JH
    Lim, JD
    Seo, DW
    [J]. PDPTA'2001: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, 2001, : 1919 - 1924
  • [5] Improving reading performance by file prefetching mechanism in distributed cache systems
    Gui, Jing
    Wang, Yongbin
    Shuai, Wuyue
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2024,
  • [6] A Prefetching Mechanism Based on MooseFS
    Shi, Xiaohong
    Ji, Ying
    Xie, Hui
    Lu, Yueming
    [J]. TRUSTWORTHY COMPUTING AND SERVICES, 2014, 426 : 146 - 153
  • [7] The design and implementation of appointed file prefetching for distributed file systems
    Hwang, Gwan-Hwan
    Lin, Hsin-Fu
    Sy, Chun-Chin
    Chang, Chiu-Yang
    [J]. JOURNAL OF RESEARCH AND PRACTICE IN INFORMATION TECHNOLOGY, 2008, 40 (02): : 91 - 108
  • [8] File prefetching algorithm for concurrent streams
    Wu, Feng-Guang
    Xi, Hong-Sheng
    Xu, Chen-Feng
    [J]. Ruan Jian Xue Bao/Journal of Software, 2010, 21 (08): : 1820 - 1833
  • [9] Design and implementation of a predictive file prefetching algorithm
    Kroeger, TM
    Long, DDE
    [J]. USENIX ASSOCIATION PROCEEDINGS OF THE 2001 USENIX ANNUAL TECHNICAL CONFERENCE, 2001, : 105 - 118
  • [10] Why does file system prefetching work?
    Shriver, E
    Small, C
    Smith, KA
    [J]. PROCEEDINGS OF THE 1999 USENIX ANNUAL TECHNICAL CONFERENCE, 1999, : 71 - 84