Scalable Metadata Management Techniques for Ultra-Large Distributed Storage Systems - A Systematic Review

被引:9
|
作者
Singh, Harcharan Jit [1 ]
Bawa, Seema [1 ]
机构
[1] Thapar Univ, Comp Sci & Engn Dept, Patiala 147004, Punjab, India
关键词
Distributed computing; big data storage systems; distributed file system; data-intensive computing; metadata management; scalability; load balancing; locality; namespace; FILE-SYSTEMS; PERFORMANCE; SERVICE; OVERLAY; SCALE; CODA;
D O I
10.1145/3212686
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The provisioning of an efficient ultra-large scalable distributed storage system for expanding cloud applications has been a challenging job for researchers in academia and industry. In such an ultra-large-scale storage system, data are distributed onmultiple storage nodes for performance, scalability, and availability. The access to this distributed data is through itsmetadata, maintained bymultiple metadata servers. Themetadata carries information about the physical address of data and access privileges. The efficiency of a storage system highly depends on effective metadata management. This research presents an extensive systematic literature analysis of metadata management techniques in storage systems. This research work will help researchers to find the significance of metadata management and important parameters of metadata management techniques for storage systems. Methodical examination of metadata management techniques developed by various industry and research groups is described. The different metadata distribution techniques lead to various taxonomies. Furthermore, the article investigates techniques based on distribution structures and key parameters of metadata management. It also presents strengths and weaknesses of individual existing techniques that will help researchers to select the most appropriate technique for specific applications. Finally, it discusses existing challenges and significant research directions in metadata management for researchers.
引用
收藏
页数:37
相关论文
共 50 条
  • [31] AMP: An Affinity-based Metadata Prefetching Scheme in Large-Scale Distributed Storage Systems
    Lin, Lin
    Li, Xuemin
    Jiang, Hong
    Zhu, Yifeng
    Tian, Lei
    [J]. CCGRID 2008: EIGHTH IEEE INTERNATIONAL SYMPOSIUM ON CLUSTER COMPUTING AND THE GRID, VOLS 1 AND 2, PROCEEDINGS, 2008, : 459 - +
  • [32] MetaFlow: A Scalable Metadata Lookup Service for Distributed File Systems in Data Centers
    Sun, Peng
    Wen, Yonggang
    Duong Nguyen Binh Ta
    Xie, Haiyong
    [J]. IEEE TRANSACTIONS ON BIG DATA, 2018, 4 (02) : 203 - 216
  • [33] A new interleaved ultra-large gain converter for sustainable energy systems
    Nouri, Tohid
    Shaneh, Mahdi
    [J]. IET POWER ELECTRONICS, 2021, 14 (01) : 90 - 105
  • [34] Distributed Estimation Techniques for Cyber-Physical Systems: A Systematic Review
    Ierardi, Carmelina
    Orihuela, Luis
    Jurado, Isabel
    [J]. SENSORS, 2019, 19 (21)
  • [35] Hierarchical Bloom Filter Arrays (HBA): A novel, scalable metadata management system for large cluster-based storage
    Zhu, YF
    Jiang, H
    Wang, J
    [J]. 2004 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING, 2004, : 165 - 174
  • [36] Data deduplication techniques for efficient cloud storage management: a systematic review
    Kaur, Ravneet
    Chana, Inderveer
    Bhattacharya, Jhilik
    [J]. JOURNAL OF SUPERCOMPUTING, 2018, 74 (05): : 2035 - 2085
  • [37] Data deduplication techniques for efficient cloud storage management: a systematic review
    Ravneet Kaur
    Inderveer Chana
    Jhilik Bhattacharya
    [J]. The Journal of Supercomputing, 2018, 74 : 2035 - 2085
  • [38] Scalable Distributed Decision-Making and Coordination in Large and Complex Systems: Methods, Techniques, and Models
    Lujak, Marin
    Giordani, Stefano
    Omicini, Andrea
    Ossowski, Sascha
    [J]. COMPLEXITY, 2020, 2020
  • [39] Scalable Data Management in Distributed Information Systems
    Remedios Pallardo-Lozoya, M.
    Esparza-Peidro, Javier
    Garcia-Escriva, Jose-Ramon
    Decker, Hendrik
    Munoz-Escoi, Francesc D.
    [J]. ON THE MOVE TO MEANINGFUL INTERNET SYSTEMS: OTM 2011 WORKSHOPS, 2011, 7046 : 208 - 217
  • [40] Efficient and Scalable Metadata Management in EB-Scale File Systems
    Xu, Quanqing
    Arumugam, Rajesh Vellore
    Yong, Khai Leong
    Mahadevan, Sridhar
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2014, 25 (11) : 2840 - 2850