Heterogeneity-Aware Codes With Uncoded Repair for Distributed Storage Systems

被引:15
|
作者
Zhu, Bing [1 ]
Shum, Kenneth W. [2 ]
Li, Hui [3 ,4 ]
机构
[1] Peking Univ, Sch Elect & Comp Engn, Shenzhen 518055, Peoples R China
[2] Chinese Univ Hong Kong, Inst Network Coding, Shatin, Hong Kong, Peoples R China
[3] Peking Univ, Inst Big Data Technol, Shenzhen 518055, Peoples R China
[4] Peking Univ, Shenzhen Engn Lab Converged Networks Technol, Shenzhen 518055, Peoples R China
关键词
Distributed storage systems; regenerating codes; repair bandwidth; uncoded repair; combinatorial designs; EXACT-REGENERATING CODES;
D O I
10.1109/LCOMM.2015.2415495
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
In practical large-scale distributed storage systems, node failures are unavoidable. It is therefore desirable to quickly recreate the failed nodes in order to maintain the system integrity. In this letter, we consider a family of erasure codes that provide uncoded repair, where the failed node is regenerated by transfer of data without extra arithmetic operations. We introduce flexible fractional repetition (FFR) code, of which the coding scheme is a concatenation of an outer MDS code and an inner repetition code. Our proposed codes are applicable to the heterogeneous network environment where node storage capacities and packet repetition degrees vary in a wide range. We present explicit constructions of FFR codes by utilizing combinatorial designs. We further propose a heuristic code construction. Evaluation results show that FFR codes outperform regenerating codes in node repair efficiency.
引用
收藏
页码:901 / 904
页数:4
相关论文
共 50 条
  • [1] Heterogeneity-Aware Data Regeneration in Distributed Storage Systems
    Wang, Yan
    Wei, Dongsheng
    Yin, Xunrui
    Wang, Xin
    2014 PROCEEDINGS IEEE INFOCOM, 2014, : 1878 - 1886
  • [2] Proxy-Assisted Regenerating Codes With Uncoded Repair for Distributed Storage Systems
    Hu, Yuchong
    Lee, Patrick P. C.
    Shum, Kenneth W.
    Zhou, Pan
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2018, 64 (04) : 2512 - 2528
  • [3] Analysis and Construction of Functional Regenerating Codes with Uncoded Repair for Distributed Storage Systems
    Hu, Yuchong
    Lee, Patrick P. C.
    Shum, Kenneth W.
    2013 PROCEEDINGS IEEE INFOCOM, 2013, : 2355 - 2363
  • [4] Reducing Repair Traffic with Exact and Uncoded Repair in Distributed Storage Systems: Intersecting Zigzag Sets Codes on Hierarchical Codes
    You, Pengfei
    Huang, Zhen
    Wang, Changjian
    Peng, Yuxing
    2014 IEEE 17TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND ENGINEERING (CSE), 2014, : 722 - 728
  • [5] General Functional Regenerating Codes with Uncoded Repair for Distributed Storage System
    Liu, Qing
    Feng, Dan
    Shi, Zhan
    Fu, Min
    2015 15TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING, 2015, : 372 - 381
  • [6] Heterogeneity-aware Distributed Parameter Servers
    Jiang, Jiawei
    Cui, Bin
    Zhang, Ce
    Yu, Lele
    SIGMOD'17: PROCEEDINGS OF THE 2017 ACM INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2017, : 463 - 478
  • [7] Heterogeneity-Aware Graph Partitioning for Distributed Deployment of Multiagent Systems
    Davoodi, Mohammadreza
    Velni, Javad Mohammadpour
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (04) : 2578 - 2588
  • [8] Heterogeneity-aware distributed access structure
    Beltrán, AG
    Milligan, P
    Sage, P
    FIFTH IEEE INTERNATIONAL CONFERENCE ON PEER-TO-PEER COMPUTING, PROCEEDINGS, 2005, : 152 - 153
  • [9] hatS: A Heterogeneity-Aware Tiered Storage for Hadoop
    Krish, K. R.
    Anwar, Ali
    Butt, Ali R.
    2014 14TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING (CCGRID), 2014, : 502 - 511
  • [10] Heterogeneity-Aware Resource Allocation in HPC Systems
    Netti, Alessio
    Galleguillos, Cristian
    Kiziltan, Zeynep
    Sirbu, Alina
    Babaoglu, Ozalp
    HIGH PERFORMANCE COMPUTING, ISC HIGH PERFORMANCE 2018, 2018, 10876 : 3 - 21