Two-level Hash/Table approach for metadata management in distributed file systems

被引:6
|
作者
Diaz, Antonio F. [1 ]
Anguita, Mancia [1 ]
Camacho, Hugo E. [1 ]
Nieto, Erik [1 ]
Ortega, Julio [1 ]
机构
[1] Univ Granada, Dept Comp Architecture & Comp Technol, Granada, Spain
来源
JOURNAL OF SUPERCOMPUTING | 2013年 / 64卷 / 01期
关键词
File system; Storage system; Metadata management; Metadata cache;
D O I
10.1007/s11227-012-0801-y
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
AbFS is a distributed file system that makes it possible to efficiently share the inexpensive devices attached to the commodity computers of a cluster. The implementation of AbFS offers high-performance metadata management by combining hashing and tables in several levels, hierarchical structures and caches, and by combining the attributes and the namespace in the same structure. No additional layers are needed to implement caches because AbFS uses the Linux metadata caches, inode and dentry, to implement them. Along with the description of the proposed implementation for metadata management and the comparison with other implementations, this work provides experimental results to evaluate its performance obtained with a prototype made from scratch at kernel level. AbFS experimental results show that the implementation proposed is capable to manage files and directories with high performance.
引用
收藏
页码:144 / 155
页数:12
相关论文
共 50 条
  • [1] Two-level Hash/Table approach for metadata management in distributed file systems
    Antonio F. Díaz
    Mancia Anguita
    Hugo E. Camacho
    Erik Nieto
    Julio Ortega
    [J]. The Journal of Supercomputing, 2013, 64 : 144 - 155
  • [2] Decentralized Metadata Management Research Based On Distributed Hash Table Technology
    Wang Dandong
    Fang Yu
    [J]. 2012 INTERNATIONAL CONFERENCE ON INDUSTRIAL CONTROL AND ELECTRONICS ENGINEERING (ICICEE), 2012, : 1892 - 1895
  • [3] Constructing a two-level topology-aware distributed hash table with a hierarchical network coordinate system
    Deng, Ze
    Wei, Dong
    Peng, Wei-Zhou
    Zhang, Si-Fa
    [J]. International Journal of Digital Content Technology and its Applications, 2011, 5 (08) : 203 - 214
  • [4] DeepHash: An End-to-End Learning Approach for Metadata Management in Distributed File Systems
    Gao, Yuanning
    Gao, Xiaofeng
    Chen, Guihai
    [J]. PROCEEDINGS OF THE 48TH INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING (ICPP 2019), 2019,
  • [5] FileScale: Fast and Elastic Metadata Management for Distributed File Systems
    Liao, Gang
    Abadi, Daniel J.
    [J]. PROCEEDINGS OF THE 2023 ACM SYMPOSIUM ON CLOUD COMPUTING, SOCC 2023, 2023, : 459 - 474
  • [6] An End-to-End Learning-Based Metadata Management Approach for Distributed File Systems
    Gao, Yuanning
    Gao, Xiaofeng
    Zhang, Ruisi
    Chen, Guihai
    [J]. IEEE TRANSACTIONS ON COMPUTERS, 2022, 71 (05) : 1021 - 1034
  • [7] The Metadata Management Algorithm Based on Hash Postfix Table
    Li, Xiujuan
    Ju, Shiguang
    Cai, Tao
    [J]. 2010 INTERNATIONAL COLLOQUIUM ON COMPUTING, COMMUNICATION, CONTROL, AND MANAGEMENT (CCCM2010), VOL I, 2010, : 312 - 315
  • [8] Design and Implementation of a Metadata Management Scheme for Large Distributed File Systems
    Yun, Jong Hyeon
    Park, Yong Hun
    Seo, Dong Min
    Lee, Seok Jae
    Yoo, Jae Soo
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2009, E92D (07): : 1475 - 1478
  • [9] LOAD REBALANCING FOR HADOOP DISTRIBUTED FILE SYSTEM USING DISTRIBUTED HASH TABLE
    Nithya, M.
    Maheshwari, N. Uma
    [J]. PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON INTELLIGENT SUSTAINABLE SYSTEMS (ICISS 2017), 2017, : 939 - 943
  • [10] Metadata Namespace Management of Distributed File System
    Luo, Baoshan
    Zhang, Xinyan
    Tan, Zhipeng
    [J]. 14TH INTERNATIONAL SYMPOSIUM ON DISTRIBUTED COMPUTING AND APPLICATIONS FOR BUSINESS, ENGINEERING AND SCIENCE (DCABES 2015), 2015, : 21 - 25