Metadata efficiency in versioning file systems

被引:0
|
作者
Soules, CA [1 ]
Goodson, GR [1 ]
Strunk, JD [1 ]
Ganger, GR [1 ]
机构
[1] Carnegie Mellon Univ, Pittsburgh, PA 15213 USA
关键词
D O I
暂无
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Versioning file systems retain earlier versions of modified files, allowing recovery from user mistakes or system corruption. Unfortunately, conventional versioning systems do not efficiently record large numbers of versions. In particular, versioned metadata can consume as much space as versioned data. This paper examines two space-efficient metadata structures for versioning file systems and describes their integration into the Comprehensive Versioning File System (CVFS), which keeps all versions of all files. Journal-based metadata encodes each metadata version into a single journal entry; CVFS uses this structure for inodes and indirect blocks, reducing the associated space requirements by 80%. Multiversion b-trees extend each entry's key with a timestamp and keep current and historical entries in a single tree; CVFS uses this structure for directories, reducing the associated space requirements by 99%. Similar space reductions are predicted via trace analysis for other versioning strategies (e.g., on-close versioning). Experiments with CVFS verify that its current-version performance is similar to that of non-versioning file systems while reducing overall space needed for history data by a factor of two. Although access to historical versions is slower than conventional versioning systems, checkpointing is shown to mitigate and bound this effect.
引用
收藏
页码:43 / 58
页数:16
相关论文
共 50 条
  • [1] Metadata changes in large file systems: a metadata querying perspective
    Liu, Likun
    Chen, Cheng
    Wu, Yongwei
    Yang, Guangwen
    [J]. COMPUTER SYSTEMS SCIENCE AND ENGINEERING, 2011, 26 (05): : 365 - 374
  • [2] Analyzing Metadata Performance in Distributed File Systems
    Biardzki, Christoph
    Ludwig, Thomas
    [J]. PARALLEL COMPUTING TECHNOLOGIES, PROCEEDINGS, 2009, 5698 : 8 - +
  • [3] Efficient metadata management for flash file systems
    Kim, Jaegeuk
    Jo, Heeseung
    Shim, Hyotaek
    Kim, Jin-Soo
    Maeng, Seungryoul
    [J]. ISORC 2008: 11TH IEEE SYMPOSIUM ON OBJECT/COMPONENT/SERVICE-ORIENTED REAL-TIME DISTRIBUTED COMPUTING - PROCEEDINGS, 2008, : 535 - 540
  • [4] A Flattened Metadata Service for Distributed File Systems
    Li, Siyang
    Liu, Fenlin
    Shu, Jiwu
    Lu, Youyou
    Li, Tao
    Hu, Yang
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2018, 29 (12) : 2641 - 2657
  • [5] DMetabench—a metadata benchmark for distributed file systems
    Christoph Biardzki
    Thomas Ludwig
    [J]. The Journal of Supercomputing, 2011, 57 : 179 - 188
  • [6] Revisiting the Metadata Architecture of Parallel File Systems
    Ali, Nawab
    Devulapalli, Ananth
    Dalessandro, Dennis
    Wyckoff, Pete
    Sadayappan, P.
    [J]. PDSW'08: PROCEEDINGS OF THE 2008 3RD PETASCALE DATA STORAGE WORKSHOP, 2008, : 63 - +
  • [7] File Creation Optimization for Metadata-Intensive Application in File Systems
    Xiao, Limin
    Zhong, Qiaoling
    Huo, Zhisheng
    Li, Ang
    Ruan, Li
    Liu, Kelong
    Zang, Yuanyuan
    Lu, Zheqi
    [J]. ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2015, 2015, 9532 : 353 - 363
  • [8] Metadata Versioning for DW 2.0 Architecture
    Pan Ding
    Pan Yunshan
    [J]. PROCEEDINGS OF THE 29TH CHINESE CONTROL CONFERENCE, 2010, : 5106 - 5109
  • [9] Log-Less Metadata Management on Metadata Server for Parallel File Systems
    Liao, Jianwei
    Xiao, Guoqiang
    Peng, Xiaoning
    [J]. SCIENTIFIC WORLD JOURNAL, 2014,
  • [10] Secure deletion for a versioning file system
    Peterson, ZNJ
    Burns, R
    Herring, J
    Stubblefield, A
    Rubin, AD
    [J]. USENIX ASSOCIATION PROCEEDINGS OF THE 4TH USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES, 2005, : 143 - 154