Scalable Metadata Management Techniques for Ultra-Large Distributed Storage Systems - A Systematic Review

被引:9
|
作者
Singh, Harcharan Jit [1 ]
Bawa, Seema [1 ]
机构
[1] Thapar Univ, Comp Sci & Engn Dept, Patiala 147004, Punjab, India
关键词
Distributed computing; big data storage systems; distributed file system; data-intensive computing; metadata management; scalability; load balancing; locality; namespace; FILE-SYSTEMS; PERFORMANCE; SERVICE; OVERLAY; SCALE; CODA;
D O I
10.1145/3212686
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The provisioning of an efficient ultra-large scalable distributed storage system for expanding cloud applications has been a challenging job for researchers in academia and industry. In such an ultra-large-scale storage system, data are distributed onmultiple storage nodes for performance, scalability, and availability. The access to this distributed data is through itsmetadata, maintained bymultiple metadata servers. Themetadata carries information about the physical address of data and access privileges. The efficiency of a storage system highly depends on effective metadata management. This research presents an extensive systematic literature analysis of metadata management techniques in storage systems. This research work will help researchers to find the significance of metadata management and important parameters of metadata management techniques for storage systems. Methodical examination of metadata management techniques developed by various industry and research groups is described. The different metadata distribution techniques lead to various taxonomies. Furthermore, the article investigates techniques based on distribution structures and key parameters of metadata management. It also presents strengths and weaknesses of individual existing techniques that will help researchers to select the most appropriate technique for specific applications. Finally, it discusses existing challenges and significant research directions in metadata management for researchers.
引用
收藏
页数:37
相关论文
共 50 条
  • [1] LaMeta: An efficient locality aware metadata management technique for an ultra-large distributed storage system
    Singh, Harcharan Jit
    Bawa, Seema
    [J]. JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (10) : 8323 - 8335
  • [2] Efficient metadata management in large distributed storage systems
    Brandt, SA
    Miller, EL
    Long, DDE
    Xue, L
    [J]. 20TH IEEE/11TH NASA GODDARD CONFERENCE ON MASS STORAGE AND TECHNOLOGIES (MSST 2003), PROCEEDINGS, 2003, : 290 - 298
  • [3] Scalable and Adaptive Metadata Management in Ultra Large-scale File Systems
    Hua, Yu
    Zhu, Yifeng
    Jiang, Hong
    Feng, Dan
    Tian, Lei
    [J]. 28TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS, VOLS 1 AND 2, PROCEEDINGS, 2008, : 403 - +
  • [4] A Novel Dynamic Metadata Management Scheme for Large Distributed Storage Systems
    Fu, Yinjin
    Xiao, Nong
    Zhou, Enqiang
    [J]. HPCC 2008: 10TH IEEE INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS, PROCEEDINGS, 2008, : 987 - 992
  • [5] HBA: Distributed metadata management for large cluster-based storage systems
    Zhu, Yifeng
    Jiang, Hong
    Wang, Jun
    Xian, Feng
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2008, 19 (06) : 750 - 763
  • [6] Synchronous Metadata Management of Large Storage Systems
    Hackl, Guenter
    Pausch, Wolfgang
    Schoenherr, Sebastian
    Specht, Guenther
    Thiel, Gunther
    [J]. PROCEEDINGS OF THE FOURTEENTH INTERNATIONAL DATABASE ENGINEERING & APPLICATIONS SYMPOSIUM (IDEAS '10), 2010, : 1 - 6
  • [7] Innovated scalable efficient inference for ultra-large graphical models
    Zhou, Jia
    Zheng, Zemin
    Zhou, Huiting
    Dong, Ruipeng
    [J]. STATISTICS & PROBABILITY LETTERS, 2021, 173
  • [8] A DECENTRALIZED AND SCALABLE METADATA SERVER MANAGEMENT SYSTEM FOR LARGE-SCALE DATA STORAGE
    Chen Ningjiang
    Xiao Zhongzheng
    [J]. JOURNAL OF INVESTIGATIVE MEDICINE, 2014, 62 (08) : S17 - S17
  • [9] A coordination model for ultra-large scale systems of systems
    Bujorianu, Manuela L.
    Bujorianu, Marius C.
    [J]. ELECTRONIC PROCEEDINGS IN THEORETICAL COMPUTER SCIENCE, 2013, (133): : 84 - 98
  • [10] Design and Implementation of a Metadata Management Scheme for Large Distributed File Systems
    Yun, Jong Hyeon
    Park, Yong Hun
    Seo, Dong Min
    Lee, Seok Jae
    Yoo, Jae Soo
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2009, E92D (07): : 1475 - 1478