Heterogeneity-Aware Codes With Uncoded Repair for Distributed Storage Systems

被引:15
|
作者
Zhu, Bing [1 ]
Shum, Kenneth W. [2 ]
Li, Hui [3 ,4 ]
机构
[1] Peking Univ, Sch Elect & Comp Engn, Shenzhen 518055, Peoples R China
[2] Chinese Univ Hong Kong, Inst Network Coding, Shatin, Hong Kong, Peoples R China
[3] Peking Univ, Inst Big Data Technol, Shenzhen 518055, Peoples R China
[4] Peking Univ, Shenzhen Engn Lab Converged Networks Technol, Shenzhen 518055, Peoples R China
关键词
Distributed storage systems; regenerating codes; repair bandwidth; uncoded repair; combinatorial designs; EXACT-REGENERATING CODES;
D O I
10.1109/LCOMM.2015.2415495
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
In practical large-scale distributed storage systems, node failures are unavoidable. It is therefore desirable to quickly recreate the failed nodes in order to maintain the system integrity. In this letter, we consider a family of erasure codes that provide uncoded repair, where the failed node is regenerated by transfer of data without extra arithmetic operations. We introduce flexible fractional repetition (FFR) code, of which the coding scheme is a concatenation of an outer MDS code and an inner repetition code. Our proposed codes are applicable to the heterogeneous network environment where node storage capacities and packet repetition degrees vary in a wide range. We present explicit constructions of FFR codes by utilizing combinatorial designs. We further propose a heuristic code construction. Evaluation results show that FFR codes outperform regenerating codes in node repair efficiency.
引用
收藏
页码:901 / 904
页数:4
相关论文
共 50 条
  • [41] Heterogeneity-aware routing protocol in overlay network
    Ju Hong-Jun
    Wu Jing
    2011 7TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, NETWORKING AND MOBILE COMPUTING (WICOM), 2011,
  • [42] Scalable Family of Codes with Locality and Availability for Information Repair in Distributed Storage Systems
    Farkas, Peter
    2019 4TH INTERNATIONAL CONFERENCE ON SMART AND SUSTAINABLE TECHNOLOGIES (SPLITECH), 2019, : 156 - 159
  • [43] A Generic Transformation to Enable Optimal Repair in MDS Codes for Distributed Storage Systems
    Li, Jie
    Tang, Xiaohu
    Tian, Chao
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2018, 64 (09) : 6257 - 6267
  • [44] LDPC Codes for Distributed Storage systems
    Bhuvaneshwari, P., V
    Tharini, C.
    2019 11TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING (ICOAC 2019), 2019, : 34 - 40
  • [45] SCHEDTUNE: A Heterogeneity-Aware GPU Scheduler for Deep Learning
    Albahar, Hadeel
    Dongare, Shruti
    Du, Yanlin
    Zhao, Nannan
    Paul, Arnab K.
    Butt, Ali R.
    2022 22ND IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND INTERNET COMPUTING (CCGRID 2022), 2022, : 695 - 705
  • [46] BASIC Codes for Distributed Storage Systems
    Hou, Hanxu
    Han, Yunghsiang S.
    2017 26TH INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATION AND NETWORKS (ICCCN 2017), 2017,
  • [47] Cascade Codes for Distributed Storage Systems
    Elyasi, Mehran
    Mohajer, Soheil
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2020, 66 (12) : 7490 - 7527
  • [48] Predictive Heterogeneity-Aware Application Scheduling for Chip Multiprocessors
    Chen, Jian
    Nair, Arun Arvind
    John, Lizy K.
    IEEE TRANSACTIONS ON COMPUTERS, 2014, 63 (02) : 435 - 447
  • [49] GrapH: Heterogeneity-Aware Graph Computation with Adaptive Partitioning
    Mayer, Christian
    Tariq, Muhammad Adnan
    Li, Chen
    Rothermel, Kurt
    PROCEEDINGS 2016 IEEE 36TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS ICDCS 2016, 2016, : 118 - 128
  • [50] Green- and Heterogeneity-Aware Partitioning for Data Analytics
    Chakrabarti, Aniket
    Parthasarathy, Srinivasan
    Stewart, Christopher
    2016 IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (INFOCOM WKSHPS), 2016,