Metadata Indexing Sub-system for Distributed File System

被引:1
|
作者
Niu Dejiao [1 ]
Cai Tao [1 ]
Zhan Yongzhao [1 ]
Ju Shiguang [1 ]
机构
[1] JiangSu Univ, Dept Comp, Zhenjiang 212013, Peoples R China
关键词
distributed file system; metadata indexing; metadata management; Lustre;
D O I
10.4028/www.scientific.net/AMM.143-144.864
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The efficiency of metadata indexing is important to the performance of distributed file system. Time and space spending of current metadata management algorithms are unstable. In this paper, we use B-tree to index the metadata of distributed file system. Lustre is an open source distributed file system in which Hash function is used to manage the metadata. We implement the prototype of metadata indexing sub-system on Lustre and use Iozone to test the I/O performance of Lustre with and without the metadata indexing sub-system respectively. The simulation results show that Lustre with the metadata indexing sub-system has higher adaptability than Lustre with Hash-based metadata management algorithm.
引用
收藏
页码:864 / 868
页数:5
相关论文
共 50 条
  • [1] Metadata Namespace Management of Distributed File System
    Luo, Baoshan
    Zhang, Xinyan
    Tan, Zhipeng
    [J]. 14TH INTERNATIONAL SYMPOSIUM ON DISTRIBUTED COMPUTING AND APPLICATIONS FOR BUSINESS, ENGINEERING AND SCIENCE (DCABES 2015), 2015, : 21 - 25
  • [2] DMFSsim: a Distributed Metadata File System Simulator
    Wu, Qimeng
    Xie, Ke
    Zhu, Mingfa
    Xiao, Limin
    Ruan, Li
    [J]. INDUSTRIAL INSTRUMENTATION AND CONTROL SYSTEMS, PTS 1-4, 2013, 241-244 : 1556 - 1561
  • [3] A Novel Distributed File System Using Blockchain Metadata
    Deepa S. Kumar
    S. Dija
    M. D. Sumithra
    M. Abdul Rahman
    Praseeda B. Nair
    [J]. Wireless Personal Communications, 2023, 129 : 501 - 520
  • [4] A Novel Distributed File System Using Blockchain Metadata
    Kumar, Deepa S.
    Dija, S.
    Sumithra, M. D.
    Rahman, M. Abdul
    Nair, Praseeda B.
    [J]. WIRELESS PERSONAL COMMUNICATIONS, 2023, 129 (01) : 501 - 520
  • [5] Research on Metadata Management Scheme of Distributed File System
    Huo, Lin
    Yi, Ran
    [J]. 2015 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND APPLICATIONS (CSA), 2015, : 37 - 41
  • [6] Distributed Metadata Management for Exascale Parallel File System
    Yamamoto, Keiji
    Hori, Atushi
    Ishikawa, Yutaka
    [J]. 2012 SC COMPANION: HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS (SCC), 2012, : 1438 - 1438
  • [7] Performance Study on Indexing and Accessing of Small File in Hadoop Distributed File System
    Rodrigues, Anisha P.
    Fernandes, Roshan
    Vijaya, P.
    Chander, Satish
    [J]. JOURNAL OF INFORMATION & KNOWLEDGE MANAGEMENT, 2021, 20 (04)
  • [8] AGRICULTURAL SUB-SYSTEM
    MARSTRAND, PK
    PAVITT, KLR
    [J]. FUTURES, 1973, 5 (01) : 56 - 65
  • [9] POLLUTION SUB-SYSTEM
    MARSTRAND, PK
    SINCLAIR, TC
    [J]. FUTURES, 1973, 5 (01) : 80 - 89
  • [10] POPULATION SUB-SYSTEM
    PAGE, W
    [J]. FUTURES, 1973, 5 (01) : 43 - 55