Exploring high performance distributed file storage using LDPC codes

被引:10
|
作者
Gaidioz, Benjamin [1 ]
Koblitz, Birger
Santos, Nuno
机构
[1] Ecole Polytech Fed Lausanne, CH-1015 Lausanne, Switzerland
[2] CERN, European Org Nucl Res, CH-1211 Geneva, Switzerland
关键词
distributed file storage; low-density parity-check (LDPC) codes; high-availability; high-performance;
D O I
10.1016/j.parco.2007.02.003
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We explore the feasibility of implementing a reliable, high performance, distributed storage system on a commodity computing cluster. Files are distributed across storage nodes using erasure coding with small low-density parity-check (LDPC) codes, which provide high-reliability with small storage and performance overhead. We present performance measurements done on a prototype system comprising 50 nodes, which are self organised using a peer-to-peer overlay. (C) 2007 Elsevier B.V. All rights reserved.
引用
收藏
页码:264 / 274
页数:11
相关论文
共 50 条
  • [31] Performance Analysis of LDPC Convolutional Codes
    Baloch, Zahoor Ahmed
    Hussain, Ayaz
    Hussain, Noor
    2013 INTERNATIONAL CONFERENCE ON ICT CONVERGENCE (ICTC 2013): FUTURE CREATIVE CONVERGENCE TECHNOLOGIES FOR NEW ICT ECOSYSTEMS, 2013, : 587 - 592
  • [32] Using of LDPC codes in steganography
    Diop, I.
    Farssi, S.M.
    Chaumont, M.
    Khouma, O.
    Diouf, H.B.
    Tall, K.
    Sylla, K.
    Journal of Theoretical and Applied Information Technology, 2012, 38 (01) : 103 - 109
  • [33] Implementation and performance of a parallel file system for high performance distributed applications
    Ligon, WB
    Ross, RB
    PROCEEDINGS OF THE FIFTH IEEE INTERNATIONAL SYMPOSIUM ON HIGH PERFORMANCE DISTRIBUTED COMPUTING, 1996, : 471 - 480
  • [34] Performance improvement of distributed file system using tunneling
    Pesicka, Ladislav
    Matejka, Lubos
    Safarik, Jiri
    Racek, Stanislav
    PROCEEDINGS OF THE FIFTH EUROPEAN CONFERENCE ON THE ENGINEERING OF COMPUTER-BASED SYSTEMS (ECBS 2017), 2017,
  • [35] On the performance slope of short LDPC codes
    Medova, Luiza R.
    Rybin, Pavel S.
    Sidorenko, Igor E.
    2020 12TH INTERNATIONAL CONGRESS ON ULTRA MODERN TELECOMMUNICATIONS AND CONTROL SYSTEMS AND WORKSHOPS (ICUMT 2020), 2020, : 67 - 72
  • [36] DAVINCI Codes as Example of High Performance Non-Binary LDPC
    Kiedrowski, Lukasz
    Gierszal, Henryk
    Holubowicz, Witold
    Flizikowski, Adam
    INTERNATIONAL JOURNAL OF ELECTRONICS AND TELECOMMUNICATIONS, 2009, 55 (03) : 417 - 433
  • [37] Shorten LDPC Codes with Better Performance
    Li, Huiya
    Shi, Jianying
    Men, Jinxi
    COMPUTER AND INFORMATION TECHNOLOGY, 2014, 519-520 : 983 - +
  • [38] Architecture of a NVM-based Storage System Using Adaptive LDPC Codes
    Korkotsides, Stelios
    Antonakopoulos, Theodore A.
    2016 5TH INTERNATIONAL CONFERENCE ON MODERN CIRCUITS AND SYSTEMS TECHNOLOGIES (MOCAST), 2016,
  • [39] On the performance analysis of short LDPC codes
    Medova, Luiza R.
    Rybin, Pavel S.
    Filatov, Ivan, V
    2019 XVI INTERNATIONAL SYMPOSIUM PROBLEMS OF REDUNDANCY IN INFORMATION AND CONTROL SYSTEMS (REDUNDANCY), 2019, : 18 - 22
  • [40] High performance short-block binary regular LDPC codes
    Mostari, Latifa
    Taleb-Ahmed, Abdelmalik
    ALEXANDRIA ENGINEERING JOURNAL, 2018, 57 (04) : 2633 - 2639