Exploring high performance distributed file storage using LDPC codes

被引：10
|
作者：
Gaidioz, Benjamin [1 ]
Koblitz, Birger
Santos, Nuno
机构：
[1] Ecole Polytech Fed Lausanne, CH-1015 Lausanne, Switzerland
[2] CERN, European Org Nucl Res, CH-1211 Geneva, Switzerland
来源：
PARALLEL COMPUTING | 2007年 / 33卷 / 4-5期
关键词：
distributed file storage; low-density parity-check (LDPC) codes; high-availability; high-performance;
D O I：
10.1016/j.parco.2007.02.003
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
We explore the feasibility of implementing a reliable, high performance, distributed storage system on a commodity computing cluster. Files are distributed across storage nodes using erasure coding with small low-density parity-check (LDPC) codes, which provide high-reliability with small storage and performance overhead. We present performance measurements done on a prototype system comprising 50 nodes, which are self organised using a peer-to-peer overlay. (C) 2007 Elsevier B.V. All rights reserved.
引用
收藏
页码：264 / 274
页数：11
相关论文
共 50 条
  • [1] LDPC Codes for Distributed Storage systems
    Bhuvaneshwari, P., V
    Tharini, C.
    2019 11TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING (ICOAC 2019), 2019, : 34 - 40
  • [2] Auto-configurable LDPC Codes For Distributed Storage
    Wei, Yongmei
    Foo, Yong Wee
    Lim, Khai Cher
    Chen, Fengmin
    2014 IEEE 17TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND ENGINEERING (CSE), 2014, : 1332 - 1338
  • [3] Block-Permutation LDPC Codes for Distributed Storage Systems
    Krouk, Evgenii
    Ovchinnikov, Andrei
    INTELLIGENT INTERACTIVE MULTIMEDIA SYSTEMS AND SERVICES, 2015, 40 : 227 - 238
  • [4] Minimum Repair Bandwidth LDPC Codes for Distributed Storage Systems
    Pourmandi, Massoud
    Pusane, Ali Emre
    Arslan, Suayb S. S.
    Haytaoglu, Elif
    IEEE COMMUNICATIONS LETTERS, 2023, 27 (02) : 428 - 432
  • [5] Exploring Untrusted Distributed Storage for High Performance Computing
    Smith, Austin
    Riley, Justin
    Syed, Muneeba
    Kupcevic, Milan
    Edmon, Paul
    Yockel, Scott
    PEARC '19: PROCEEDINGS OF THE PRACTICE AND EXPERIENCE IN ADVANCED RESEARCH COMPUTING ON RISE OF THE MACHINES (LEARNING), 2019,
  • [6] Lossy Distributed Source Coding Using LDPC Codes
    Sartipi, Mina
    Fekri, Faramarz
    IEEE COMMUNICATIONS LETTERS, 2009, 13 (02) : 136 - 138
  • [7] High Performance LDPC Codes for High Spectral Efficiency
    Mostari, Latifa
    Taleb-Ahmed, Abdelmalik
    Bounoua, Abdennacer
    INTERNETWORKING INDONESIA, 2018, 10 (01): : 9 - 15
  • [8] High Performance and Fault Tolerant Distributed File System for Big Data Storage and Processing using Hadoop
    Sivaraman, E.
    Manickachezian, R.
    2014 INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING APPLICATIONS (ICICA 2014), 2014, : 32 - 36
  • [9] Mojette Transform based LDPC Erasure Correction Codes for Distributed Storage Systems
    Arslan, Suayb S.
    Parrein, Benoit
    Normand, Nicolas
    2017 25TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2017,
  • [10] Performance Analysis of High-Rate LDPC Codes
    Mei, Ya-qing
    Yu, Seok-kun
    Joo, Eon Kyeong
    INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND INFORMATION ENGINEERING (CSIE 2015), 2015, : 36 - 39
12345