Metadata Indexing Sub-system for Distributed File System

被引:1
|
作者
Niu Dejiao [1 ]
Cai Tao [1 ]
Zhan Yongzhao [1 ]
Ju Shiguang [1 ]
机构
[1] JiangSu Univ, Dept Comp, Zhenjiang 212013, Peoples R China
关键词
distributed file system; metadata indexing; metadata management; Lustre;
D O I
10.4028/www.scientific.net/AMM.143-144.864
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The efficiency of metadata indexing is important to the performance of distributed file system. Time and space spending of current metadata management algorithms are unstable. In this paper, we use B-tree to index the metadata of distributed file system. Lustre is an open source distributed file system in which Hash function is used to manage the metadata. We implement the prototype of metadata indexing sub-system on Lustre and use Iozone to test the I/O performance of Lustre with and without the metadata indexing sub-system respectively. The simulation results show that Lustre with the metadata indexing sub-system has higher adaptability than Lustre with Hash-based metadata management algorithm.
引用
收藏
页码:864 / 868
页数:5
相关论文
共 50 条
  • [31] LCCFS: a lightweight distributed file system for cloud computing without journaling and metadata services
    Li Wang
    Jingling Xue
    Xiangke Liao
    Yunchuan Wen
    Min Chen
    [J]. Science China Information Sciences, 2019, 62
  • [32] λFS: A Scalable and Elastic Distributed File System Metadata Service using Serverless Functions
    Carver, Benjamin
    Han, Runzhou
    Zhang, Jingyuan
    Zheng, Mai
    Cheng, Yue
    [J]. PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON ARCHITECTURAL SUPPORT FOR PROGRAMMING LANGUAGES AND OPERATING SYSTEMS, ASPLOS 2023, VOL 4, 2023, : 394 - 411
  • [33] LCCFS: a lightweight distributed file system for cloud computing without journaling and metadata services
    Wang, Li
    Xue, Jingling
    Liao, Xiangke
    Wen, Yunchuan
    Chen, Min
    [J]. SCIENCE CHINA-INFORMATION SCIENCES, 2019, 62 (07)
  • [34] Reducing the Load of Metadata Server by Changing Cache Policy Dynamically in Distributed File System
    Matsuno, Masaya
    Kawashima, Ryota
    Saito, Shoich
    Matsuo, Hiroshi
    [J]. 2013 FIRST INTERNATIONAL SYMPOSIUM ON COMPUTING AND NETWORKING (CANDAR), 2013, : 173 - 179
  • [35] SingularFS: A Billion-Scale Distributed File System Using a Single Metadata Server
    Guo, Hao
    Lu, Youyou
    Lv, Wenhao
    Liao, Xiaojian
    Zeng, Shaoxun
    Shu, Jiwu
    [J]. PROCEEDINGS OF THE 2023 USENIX ANNUAL TECHNICAL CONFERENCE, 2023, : 915 - 928
  • [36] Adaptive metadata rebalance in exascale file system
    Cha, Myung-Hoon
    Kim, Dong-Oh
    Kim, Hong-Yeon
    Kim, Young-Kyun
    [J]. JOURNAL OF SUPERCOMPUTING, 2017, 73 (04): : 1337 - 1359
  • [37] On the role of file system metadata in digital forensics
    Buchholz, Florian
    Spafford, Eugene
    [J]. Digital Investigation, 2004, 1 (04) : 298 - 309
  • [38] Effective metadata management in exascale file system
    Cha, Myung-Hoon
    Lee, Sang-Min
    Kim, Hong-Yeon
    Kim, Young-Kyun
    [J]. JOURNAL OF SUPERCOMPUTING, 2019, 75 (11): : 7665 - 7689
  • [39] The role of the market sub-system and the socio-technical sub-system in innovation and firm performance: a dynamic capabilities approach
    Jay Weerawardena
    Gillian Sullivan Mort
    Sandeep Salunke
    Gary Knight
    Peter W. Liesch
    [J]. Journal of the Academy of Marketing Science, 2015, 43 : 221 - 239
  • [40] Effective metadata management in exascale file system
    Myung-Hoon Cha
    Sang-Min Lee
    Hong-Yeon Kim
    Young-Kyun Kim
    [J]. The Journal of Supercomputing, 2019, 75 : 7665 - 7689