Metadata Indexing Sub-system for Distributed File System

被引:1
|
作者
Niu Dejiao [1 ]
Cai Tao [1 ]
Zhan Yongzhao [1 ]
Ju Shiguang [1 ]
机构
[1] JiangSu Univ, Dept Comp, Zhenjiang 212013, Peoples R China
关键词
distributed file system; metadata indexing; metadata management; Lustre;
D O I
10.4028/www.scientific.net/AMM.143-144.864
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The efficiency of metadata indexing is important to the performance of distributed file system. Time and space spending of current metadata management algorithms are unstable. In this paper, we use B-tree to index the metadata of distributed file system. Lustre is an open source distributed file system in which Hash function is used to manage the metadata. We implement the prototype of metadata indexing sub-system on Lustre and use Iozone to test the I/O performance of Lustre with and without the metadata indexing sub-system respectively. The simulation results show that Lustre with the metadata indexing sub-system has higher adaptability than Lustre with Hash-based metadata management algorithm.
引用
收藏
页码:864 / 868
页数:5
相关论文
共 50 条
  • [41] Adaptive metadata rebalance in exascale file system
    Myung-Hoon Cha
    Dong-Oh Kim
    Hong-Yeon Kim
    Young-Kyun Kim
    [J]. The Journal of Supercomputing, 2017, 73 : 1337 - 1359
  • [42] Dynamic memory sub-system for reconfigurable platforms
    Ang, Su-Shin
    Constantinides, George
    [J]. 2006 INTERNATIONAL CONFERENCE ON FIELD PROGRAMMABLE LOGIC AND APPLICATIONS, PROCEEDINGS, 2006, : 933 - +
  • [43] RESPONSE OF A SYSTEM WHEN MODIFIED BY ATTACHMENT OF AN ADDITIONAL SUB-SYSTEM
    JACQUOT, RG
    [J]. JOURNAL OF SOUND AND VIBRATION, 1976, 49 (03) : 345 - 351
  • [44] A Novel Indexing Scheme for Efficient Handling of Small Files in Hadoop Distributed File System
    Chandrasekar, S.
    Dakshinamurthy, R.
    Seshakumar, P. G.
    Prabavathy, B.
    Babu, Chitra
    [J]. 2013 INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATION AND INFORMATICS, 2013,
  • [45] The role of the market sub-system and the socio-technical sub-system in innovation and firm performance: a dynamic capabilities approach
    Weerawardena, Jay
    Mort, Gillian Sullivan
    Salunke, Sandeep
    Knight, Gary
    Liesch, Peter W.
    [J]. JOURNAL OF THE ACADEMY OF MARKETING SCIENCE, 2015, 43 (02) : 221 - 239
  • [46] Research on Immune Authentication Sub-system for Networked Storage System
    Huang Jianzhong
    Li Huaiyang
    Li Xin
    [J]. EIGHTH INTERNATIONAL SYMPOSIUM ON OPTICAL STORAGE AND 2008 INTERNATIONAL WORKSHOP ON INFORMATION DATA STORAGE, 2009, 7125
  • [47] Experimental Analysis of a Polygeneration System: Assessment of the Thermal Sub-System
    Rodrigues, Andre
    Palmero-Marrero, Ana I.
    Soares, Joao
    Varga, Szabolcs
    Oliveira, Armando C.
    [J]. ENERGIES, 2024, 17 (07)
  • [48] BES III TOF Trigger sub-system
    Liu, Shubin
    Zheng, Wei
    An, Qi
    [J]. 2009 16TH IEEE-NPSS REAL TIME CONFERENCE, 2009, : 461 - 464
  • [49] Active heave crown compensation sub-system
    Hatleskog, J. T.
    Dunnigan, M. W.
    [J]. OCEANS 2007 - EUROPE, VOLS 1-3, 2007, : 139 - 144
  • [50] THE VISUAL SUB-SYSTEM CONCEPT AND SPACECRAFT ILLUMINATION
    URMER, AH
    JONES, ER
    [J]. HUMAN FACTORS, 1963, 5 (03) : 275 - 283