Exploring high performance distributed file storage using LDPC codes

被引：10
|
作者：
Gaidioz, Benjamin [1 ]
Koblitz, Birger
Santos, Nuno
机构：
[1] Ecole Polytech Fed Lausanne, CH-1015 Lausanne, Switzerland
[2] CERN, European Org Nucl Res, CH-1211 Geneva, Switzerland
来源：
PARALLEL COMPUTING | 2007年 / 33卷 / 4-5期
关键词：
distributed file storage; low-density parity-check (LDPC) codes; high-availability; high-performance;
D O I：
10.1016/j.parco.2007.02.003
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
We explore the feasibility of implementing a reliable, high performance, distributed storage system on a commodity computing cluster. Files are distributed across storage nodes using erasure coding with small low-density parity-check (LDPC) codes, which provide high-reliability with small storage and performance overhead. We present performance measurements done on a prototype system comprising 50 nodes, which are self organised using a peer-to-peer overlay. (C) 2007 Elsevier B.V. All rights reserved.
引用
收藏
页码：264 / 274
页数：11
相关论文
共 50 条
  • [11] High-performance LDPC codes for CDMA applications
    Haghighat, J
    Jamali, SH
    Behroozi, H
    Nasiri-Kenari, M
    2002 4TH INTERNATIONAL WORKSHOP ON MOBILE AND WIRELESS COMMUNICATION NETWORK, 2002, : 105 - 109
  • [12] Fastdfs: A high performance distributed file system
    Liu, Xiaoyan
    Yu, Qing
    Liao, Jianwei
    ICIC Express Letters, Part B: Applications, 2014, 5 (06): : 1741 - 1746
  • [13] High Performance Hadoop Distributed File System
    Mohamed Elkawkagy
    Heba Elbeh
    International Journal of Networked and Distributed Computing, 2020, 8 : 119 - 123
  • [14] High Performance Hadoop Distributed File System
    Elkawkagy, Mohamed
    Elbeh, Heba
    INTERNATIONAL JOURNAL OF NETWORKED AND DISTRIBUTED COMPUTING, 2020, 8 (03) : 119 - 123
  • [15] LDPC Codes for Portable DNA Storage
    Fei, Peng
    Wang, Zhiying
    2019 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2019, : 76 - 80
  • [16] Performance Analysis of Distributed File System Based on RAID Storage for Tapeless Storage
    Kim, Jungbin
    Yu, Hyeon-Jin
    Kang, Hyeongbin
    Shin, Jae-Hyuck
    Jeong, Heeseok
    Noh, Seo-Young
    IEEE ACCESS, 2023, 11 : 116153 - 116168
  • [17] Distributed Processing for Encoding and Decoding of Binary LDPC codes using MPI
    Gokalgandhi, Bhargav
    Seskar, Ivan
    IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (IEEE INFOCOM 2019 WKSHPS), 2019, : 596 - 601
  • [18] Selective video encryption of a distributed coded bitstream using LDPC codes
    Um, H
    Delp, EJ
    SECURITY, STEGANOGRAPHY, AND WATERMARKING OF MULTIMEDIA CONTENTS VIII, 2006, 6072
  • [19] Performance evaluation of LDPC codes in bliss scheme-based storage systems using density evolution
    Zhang, Haibin
    Hekstra, Andries P.
    Yin, Bin
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2006, 52 (03) : 879 - 887
  • [20] A Data Management in a Private Cloud Storage Environment Utilizing High Performance Distributed File Systems
    Soares, Tiago S.
    Dantas, M. A. R.
    de Macedo, Douglas D. J.
    Bauer, Michael A.
    2013 IEEE 22ND INTERNATIONAL WORKSHOP ON ENABLING TECHNOLOGIES: INFRASTRUCTURE FOR COLLABORATIVE ENTERPRISES (WETICE), 2013, : 158 - 163
12345