Reducing Repair Traffic with Exact and Uncoded Repair in Distributed Storage Systems: Intersecting Zigzag Sets Codes on Hierarchical Codes

被引:0
|
作者
You, Pengfei [1 ]
Huang, Zhen [1 ]
Wang, Changjian [1 ]
Peng, Yuxing [1 ]
机构
[1] Natl Univ Def Technol, Coll Comp, Changsha, Hunan, Peoples R China
关键词
distributed storage; network coding; regenerating code; IZS code; hierarchical code; repair traffic;
D O I
10.1109/CSE.2014.150
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Erasure code is an efficient redundancy solution to avoid permanent data losses in distributed storage system. By using erasure code, the original data is encoded into blocks which are stored on different nodes. When one node fails, the lost data block needs to be recovered by transmitting a large number of data from helper nodes, which is called repair. Intersecting zigzag sets codes (IZS codes) and hierarchical code are two kinds of codes which reduce the bandwidth overhead in repair. IZS codes reduce the amount of data uploaded by each helper node, while hierarchical codes reduce the number of nodes participating in repair. In this paper, we propose a class of code called intersecting zigzag sets-hierarchical code (IZ2SHC code) to unify them together. IZ2SHC code decreases repair degree as hierarchical code and reduces repair overhead compared with the latter. Besides, it realizes exact regeneration of the failed data, and need not encode in helper node during the repair, which reduces disk read cost for helper node when transferring data in repair.
引用
收藏
页码:722 / 728
页数:7
相关论文
共 50 条
  • [1] Heterogeneity-Aware Codes With Uncoded Repair for Distributed Storage Systems
    Zhu, Bing
    Shum, Kenneth W.
    Li, Hui
    IEEE COMMUNICATIONS LETTERS, 2015, 19 (06) : 901 - 904
  • [2] Reducing Repair Traffic in P2P Backup Systems: Exact Regenerating Codes on Hierarchical Codes
    Huang, Zhen
    Biersack, Ernst
    Peng, Yuxing
    ACM TRANSACTIONS ON STORAGE, 2011, 7 (03)
  • [3] Proxy-Assisted Regenerating Codes With Uncoded Repair for Distributed Storage Systems
    Hu, Yuchong
    Lee, Patrick P. C.
    Shum, Kenneth W.
    Zhou, Pan
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2018, 64 (04) : 2512 - 2528
  • [4] Analysis and Construction of Functional Regenerating Codes with Uncoded Repair for Distributed Storage Systems
    Hu, Yuchong
    Lee, Patrick P. C.
    Shum, Kenneth W.
    2013 PROCEEDINGS IEEE INFOCOM, 2013, : 2355 - 2363
  • [5] General Functional Regenerating Codes with Uncoded Repair for Distributed Storage System
    Liu, Qing
    Feng, Dan
    Shi, Zhan
    Fu, Min
    2015 15TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING, 2015, : 372 - 381
  • [6] New Codes and Inner Bounds for Exact Repair in Distributed Storage Systems
    Goparaju, Sreechakra
    El Rouayheb, Salim
    Calderbank, Robert
    2014 48TH ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS (CISS), 2014,
  • [7] Exact-Repair Codes With Partial Collaboration in Distributed Storage Systems
    Liu, Shiqiu
    Shum, Kenneth W.
    Li, Congduan
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2020, 68 (07) : 4012 - 4021
  • [8] New Codes and Inner Bounds for Exact Repair in Distributed Storage Systems
    Goparaju, Sreechakra
    El Rouayheb, Salim
    Calderbank, Robert
    2014 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2014, : 1036 - 1040
  • [9] Quasicyclic MDS Codes for Distributed Storage with Efficient Exact Repair
    Thangaraj, Andrew
    Sankar, Chinnadhurai
    2011 IEEE INFORMATION THEORY WORKSHOP (ITW), 2011,
  • [10] Improve readability with Exact Hierarchical Codes in Distributed Storage Systems
    Huang, Zhen
    Wang, Changjian
    Yuan, Yuan
    Liu, Lixia
    Peng, Yuxing
    INFORMATION-AN INTERNATIONAL INTERDISCIPLINARY JOURNAL, 2012, 15 (11A): : 4411 - 4416