Metadata efficiency in versioning file systems

被引:0
|
作者
Soules, CA [1 ]
Goodson, GR [1 ]
Strunk, JD [1 ]
Ganger, GR [1 ]
机构
[1] Carnegie Mellon Univ, Pittsburgh, PA 15213 USA
关键词
D O I
暂无
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Versioning file systems retain earlier versions of modified files, allowing recovery from user mistakes or system corruption. Unfortunately, conventional versioning systems do not efficiently record large numbers of versions. In particular, versioned metadata can consume as much space as versioned data. This paper examines two space-efficient metadata structures for versioning file systems and describes their integration into the Comprehensive Versioning File System (CVFS), which keeps all versions of all files. Journal-based metadata encodes each metadata version into a single journal entry; CVFS uses this structure for inodes and indirect blocks, reducing the associated space requirements by 80%. Multiversion b-trees extend each entry's key with a timestamp and keep current and historical entries in a single tree; CVFS uses this structure for directories, reducing the associated space requirements by 99%. Similar space reductions are predicted via trace analysis for other versioning strategies (e.g., on-close versioning). Experiments with CVFS verify that its current-version performance is similar to that of non-versioning file systems while reducing overall space needed for history data by a factor of two. Although access to historical versions is slower than conventional versioning systems, checkpointing is shown to mitigate and bound this effect.
引用
收藏
页码:43 / 58
页数:16
相关论文
共 50 条
  • [31] QoSFM: QoS Support for Metadata I/O In Parallel File Systems
    Xiao, Limin
    Xie, Ke
    Li, Guoying
    Ruan, Li
    Li, Xiuqiao
    [J]. 2013 IEEE 15TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS & 2013 IEEE INTERNATIONAL CONFERENCE ON EMBEDDED AND UBIQUITOUS COMPUTING (HPCC_EUC), 2013, : 29 - 38
  • [32] Concurrent design versioning system, based on XML file
    Delinchant, B
    Gerbaud, L
    Wurtz, F
    Ateinza, E
    [J]. IECON-2002: PROCEEDINGS OF THE 2002 28TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, VOLS 1-4, 2002, : 2485 - 2490
  • [33] A versatile and user-oriented versioning file system
    Muniswamy-Reddy, KK
    Wright, CP
    Himmer, A
    Zadok, E
    [J]. USENIX ASSOCIATION PROCEEDINGS OF THE 3RD USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES, 2004, : 115 - 128
  • [34] Facilitating the Efficiency of Secure File Data and Metadata Deletion on SMR-based Ext4 File System
    Chen, Ping-Xiang
    Chen, Shuo-Han
    Chang, Yuan-Hao
    Liang, Yu-Pei
    Shih, Wei-Kuan
    [J]. 2021 26TH ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE (ASP-DAC), 2021, : 728 - 733
  • [35] A Metadata Update Strategy for Large Directories in Wide-area File Systems
    Liu, Guoliang
    Liu, Zhenjun
    Ma, Liuying
    Zhang, Shuai
    Huang, Jing
    Bao, Xiuguo
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS, 2014 IEEE 6TH INTL SYMP ON CYBERSPACE SAFETY AND SECURITY, 2014 IEEE 11TH INTL CONF ON EMBEDDED SOFTWARE AND SYST (HPCC,CSS,ICESS), 2014, : 400 - 403
  • [36] Symmetric active/active metadata service for high availability parallel file systems
    He, Xubin
    Ou, Li
    Engelmann, Christian
    Chen, Xin
    Scott, Stephen L.
    [J]. JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2009, 69 (12) : 961 - 973
  • [37] An SIMD-Accelerated Metadata Management Scheme for Persistent Memory File Systems
    Hu, Zejie
    Law, Jarvan
    Chen, Zhiguang
    Xiao, Nong
    [J]. 2022 22ND IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND INTERNET COMPUTING (CCGRID 2022), 2022, : 89 - 98
  • [38] Metadata Distribution and Consistency Techniques for Large-Scale Cluster File Systems
    Xiong, Jin
    Hu, Yiming
    Li, Guojie
    Tang, Rongfeng
    Fan, Zhihua
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2011, 22 (05) : 803 - 816
  • [39] A General-Purpose Architecture for Replicated Metadata Services in Distributed File Systems
    Stamatakis, Dimokritos
    Tsikoudis, Nikos
    Micheli, Eirini
    Magoutis, Kostas
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2017, 28 (10) : 2747 - 2759
  • [40] A Low-Latency Metadata Service for Geo-Distributed File Systems
    Lin, Chuangwei
    Liu, Bowen
    Zhou, Wei
    Xu, Yueyue
    Zhang, Xuyun
    Dou, Wanchun
    [J]. WEB INFORMATION SYSTEMS ENGINEERING - WISE 2021, PT I, 2021, 13080 : 87 - 100