Metadata Namespace Management of Distributed File System

被引:0
|
作者
Luo, Baoshan [1 ]
Zhang, Xinyan [2 ]
Tan, Zhipeng [2 ]
机构
[1] Wuhan Vocat Coll Software & Engn, Sch Comp Sci, Wuhan, Peoples R China
[2] Huazhong Univ Sci & Technol, Sch Comp Sci, Wuhan, Peoples R China
关键词
distributed file system; metadata management; copy on write; multi version concurrency control;
D O I
10.1109/DCABES.2015.13
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
With the rapid development of internet, the distributed file system is gradually facing problem of supporting concurrent 10K and 100K servers operations, so it now becomes an important issue that how to improve performance of the metadata server in high concurrent reading/writing environments. This paper designs and implements the distributed file system named RaccoonFS, researches and solves the problem of low response speed of name space management brought by the lock competition in distributed file system, and it proposes a new metadata name space management method that realized the technology of Copy-On-Write and Multi-Version Concurrency Control in B+ tree. Through the evaluation, the name space management that combined COW and MVCC in B+ tree greatly improved the read and write performance.
引用
收藏
页码:21 / 25
页数:5
相关论文
共 50 条
  • [21] Metadata management in global distributed storage system
    Yi, CJ
    Jin, H
    Jia, YJ
    [J]. CURRENT TRENDS IN HIGH PERFORMANCE COMPUTING AND ITS APPLICATIONS, PROCEEDINGS, 2005, : 175 - 184
  • [22] Metadata Management for Distributed Multimedia Storage System
    Zhan, Ling
    Wan, Jiguang
    Gu, Peng
    [J]. PROCEEDINGS OF THE INTERNATIONAL SYMPOSIUM ON ELECTRONIC COMMERCE AND SECURITY, 2008, : 443 - +
  • [23] Analyzing Metadata Performance in Distributed File Systems
    Biardzki, Christoph
    Ludwig, Thomas
    [J]. PARALLEL COMPUTING TECHNOLOGIES, PROCEEDINGS, 2009, 5698 : 8 - +
  • [24] A Flattened Metadata Service for Distributed File Systems
    Li, Siyang
    Liu, Fenlin
    Shu, Jiwu
    Lu, Youyou
    Li, Tao
    Hu, Yang
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2018, 29 (12) : 2641 - 2657
  • [25] DMetabench—a metadata benchmark for distributed file systems
    Christoph Biardzki
    Thomas Ludwig
    [J]. The Journal of Supercomputing, 2011, 57 : 179 - 188
  • [26] A Distributed Cache Framework for Metadata Service of Distributed File Systems
    Sun, Yao
    Liu, Jie
    Ye, Dan
    Zhong, Hua
    [J]. 2013 19TH IEEE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS 2013), 2013, : 51 - 58
  • [27] Metadata Service for Random Frame Reading of Video Stored in Distributed File System
    Xu, Yang
    Gao, Le
    Li, Yin
    Huang, Xiaobing
    Li, Dong
    [J]. INTERNATIONAL CONFERENCE ON BIG DATA AND INTERNET OF THINGS (BDIOT 2017), 2017, : 27 - 31
  • [28] Research on the Metadata Storage Mode and Efficiency of Distributed File System Based on HGML
    Miao Fang
    Cheng Fu-chao
    Yang Wen-hui
    Tan Li
    [J]. ADVANCES IN SCIENCE AND ENGINEERING, PTS 1 AND 2, 2011, 40-41 : 221 - 227
  • [29] Clover: A distributed file system of expandable metadata service derived from HDFS
    Wang, Youwei
    Zhou, Jiang
    Ma, Can
    Wang, Weiping
    Meng, Dan
    Kei, Jason
    [J]. 2012 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING (CLUSTER), 2012, : 126 - 134
  • [30] Bristrita: Namespace and Metadata Distribution in Large-Scale Distributed Cloud Storage Systems
    Dewan, Hrishikesh
    Hansdah, R. C.
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON SMART CLOUD (SMARTCLOUD), 2018, : 116 - 124